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ABSTRACT 


This  research  examined  the  development, 
administration  and  analysis  of  the  results  of  a survey 
to  measure  the  satisfaction  of  users  with  the  contract 
administration  services  provided  by  both  the  Defense 
Contract  Administration  Services  (DCAS)  and  the  Plant 
Cognizance  activities.  The  survey  was  the  third  part 
of  an  Office  of  the  Assistant  Secretary  of  Defense 
(Installations  and  Logistics)  study  effort. 

Analysis  of  the  data  obtained  yielded  fcur 
conclusions:  (a)  the  sample  obtained  mas 
representative  of  the  Department  of  Defense 
procurement  workforce;  (b)  the  responses  to  the 
overall  evaluative  questions  were  accurate  reflections 
of  responses  to  the  individual  functional  questions; 
(c)  the  demographic  characteristics  of  the  respondents 
did  not  bias  the  evaluative  responses  and  (d;  of  the 
four  major  areas  of  contract  administration,  only 
Engineering  was  statistically  different  for  both  DCAS 
and  Plant  Cognizance  activities. 

Some  recommendations  for  further  research  and 
study  are  also  provided. 
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x. 


PROBLEM  AND  SCOPE 


i’he  Armed  Services  Procurement  Regulations  (ASPE 
1-201.4)  define  contracts  to  "...mean  all  types  of 
agreements  and  orders  for  the  procurement  of  supplies  or 
services."  According  to  Webster,  a contract  is  "an 
agreement,  especially  one  legally  enforceable,  between  two 
or  more  persons  tc  do  or  forbear  something..."  It  is  a 
bilateral  agreement  and  when  written,  sets  fcrth  the  rights 
and  obligations  cf_  the  parties  involved.  It  contains  a 
multitude  of  promises  agreed  to  by  both  parties  involving 
the  products  or  services  to  be  delivered  under  the  contract, 
the  period  of  performance  or  delivery  dates  for  the  products 
or  services,  the  price  to  be  paid  for  the  products  or 
services,  the  penalties  for  failure  of  either  party  to  abide 
by  its  promises  and  other  related  conditions. 

In  the  commercial  marketplace,  a certain  degree  of 
flexibility  and  business  freedoa  are  practiced  in  the 
everyday  course  of  business  transactions.  However,  this 
flexibility  and  freedom  are  not  desirable  in  the 
Government/Defeose  industry  marketplace  where  the 
transactions  involve  the  expenditure  of  sizeable  amounts  of 
public  funds.  Contract  administration,  as  the  Commission  on 
Government  Procurement  states,  "...involves  the  actions 
necessary  to  insure  compliance  with  the  terms  and  conditions 


of  the 

contract. " 

Contract  administration 

for 

the 

Department 

of  Defense 

has 

evolved  to 

insure 

that 

the 

contractual 

rights  of 

the 

Government 

(and,  in 

turn. 

the 

public)  are  protected. 
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Government  procurement  is  big  business.  In  fiscal  year 
1572/  it  involved  almost  16  million  separate  transactions 
and  $57  billion.  The  Department  of  Defense  was  responsible 
for  a major  portion  of  these  transactions.  In  fact/  in 
fiscal  year  1972/  DOD's  purchases  from  industry  in  America 
exceeded  $36  billion  with  over  10  million  transactions.  In 
1568,  at  the  height  of  the  Vietnam  conflict,  employment  in 
defense-related  industries  vas  approximately  3.5  million 
people.  With  the  3.5  million  military  personnel  on  active 
duty  and  the  1.3  million  people  employed  in  the  Department 
of  Defense  as  civil  service  personnel,  a total  cf  8.3 
million  people  were  involved  in  defense-related  business. 
This  represented  about  10*  of  the  nation's  work  force. 

The  responsibility  of  managing  and  administering  the  big 
business  of  Defense  procurement  initially  rests  with  the 
procuring  agency.  Within  this  organization,  decisions 
affecting  individual  procurements  are  accomplished  by  the 
Procuring  Contracting  Officer  with  advice  and  guidance 
provided  by  the  program  manager  and  the  technical  staffs. 
The  Armed  Services  Procurement  Regulations  (ASP3)  1-406  (see 
Appendix  A)  provides  for  the  delegation  of  certain  contract 
administration  responsibilities.  Por  the  Department  of 
Defense,  two  major  contract  administration  organizations  are 
available.  These  are  the  Defease  Contract  Administration 
Services  (DCAS)  managed  by  the  Defease  supply  Agency  (DSA) , 
and  the  individual  service  organizations  which  include  the 
Army  Plant  Activities,  Havy  Plant  Representative  Offices 
(NAVPROs)  and  Air  force  Plant  Representative  Offices 
(AFPROs.)  The  DCAS  organization  functions  primarily  on  a 
geographic  basis  with  a regioc/district  method  of  operation. 
It  does  have  a number  of  individual  defense  industry  plant 
assignments  which  is  the  primary  method  of  operation  for  the 
service  contract  administration  activities.  In  Harch  1972, 
DCAS  components  were  assigned  to  34  DOD  industry  plants 
while  the  services  had  responsibility  for  39  (Army:  5;  Havy: 


#' 


15i.*lr  F°tCe:  ,9’»  E«”  though  the  authority  of  these 
.artous  contract  adainistration  activities  is  derived  fro. 
he  sa.e  source,  na.ely  ASPS,  individual  policy  and 
procedural  deferences  have  arisen  fro.  parent  organization 
interpretation  and  i.ple.entation  of  the  ASPS  provisions. 

ad. ini  tT^9  ^ the  contract 

d.imstration  co.ponents  can  do  .uch  to  assist  i„  the 

effective  and  efficient  .eeting  gf  tne  defense  industry's 

and  Covern.ent's  contractual  obligations.  on  the  otLr 

hand  the  contract  ad.inistration  co.ponent  can  burden  both 

-he  Government  buying  office  and  defense  contractor  with 

unnecessary  restrictions  and  unproductive  reguire.eats.  a 

sound  procurement,  fro.  the  standpoint  of  valid  reguire.ents 

evaluations,  realistic  specifications  and  deliver7 

reguire.ents,  rationil  source  selection  and  reasonable  ter.s 

asd  con  itions,  can  be  easily  turned  into  a contractual  and 

financial  mght.are  by  the  .is-applicaticn  of  contract 

au.inistraticn  procedures  and  reguire.ents. 

Contract  ad.inistration  is  an  integral  part  of  the 
isnse  procnreoent  syste.,  a part  .hose  i.pcrtance  is  often 
under-stated.  its  i.portance  and  place  i„  dsfeose 
procure.ent  .ust  be  understood  and  appreciated. 

On  2,  duly  ,975,  the  office  of  the  Assistant  secretary 

.alor  It5!  T1  ' (InStaUatioos  logistics)  announced  a 
Jor  study  of  the  contract  ad.inistration  function  in  -he 

Deparfent  of  Defense.  The  study  was  to  enco.pass  not  only 

the  Defense  contract  Ad.inistration  Services  (DCAS,  , but 

- include  the  Ar.y,  Navy  and  Air  Porce  contract 
a .inistraticn  organizations.  the  .ajor  purpose  of  the 
study  .as  to  develop  i.proved  policies  which  would  opti.ize 
•anpower  resources  to  acco.Flish  essential  c^nt'act 
ad.inistration  tasks.  overall  direction  of  the  effort  was 
assigned  to  an  OASD  study  Coordinator  with  tne  authority  to 


w**-  ■ 


* »* 


draw  resources  and  data  from  the  +>r« 

at*  rro°  the  three  services  and  the 

Defense  Supply  Agency. 

The  acccnplishoant  of  this  study  .as  to  require  three 
Phases,  the  first  phase  involved  the  for.ation  of  joint 

‘ I”'  “3,y'  - °CAS  functional  tea.s.  These 

teaes  .ere  deposed  of  individuals,  both  .ilitar,  and 

adainistraticn,  quality  assurance,  etc.  The  tlals”nlitld 

HlZrZ  C°’P0“e“  B“4*“rt««  to  ascertain  and 

i«*  the  existence  of  policy  and  quidance  at  the 

e.  quarters,  level.  The  tea.s  then  separated  into  East  and 

* . “St  gi°afS  ««  into  selected  contract 

;:“T  activities  to  evaluate  the  iapleaentaticn  of 

the  headguarters'  policies  a*  .. 

policies  at  the  working  level.  &+  the 

-Iplrt'V"  ittitU4eS  °£  BOrltin5  ^ personnel  vere 

policy  del T a“y  S",9SSti0“S  for  iaproveoents  or 

Policy  deletion.  Innovatiye  approaches  to  contract 

administration  problems  were  also  sou-ht. 

The  second  phase  of  the  study  involved  a resource 
rc-pt^n0  aUdlt  ^ bS  acc0fflPlislied  by  the  OASD 

-Ptr°iie  , Xhis  phase  exaaiQQd  tu  ut.U2at.cn  Qf 

1ICDt9r  -a  reS0Urces  to  determine  whether  the  octimum 
unt  cr  resources  vere  being  appiled  to  accoaplish 

essential  contract  administration  tasks. 

Phase  three  of  the  study  involved  the  development  of  a 

act!  X°°Daire  t0  be  administered  at  selected  DOO  buying 
activities  tc  survey  the  attitudes  and  opinions  of  their 
personnel  to.ard  the  services  provided  to  tae.  tyte 
contract  ad.inistration  co.ponents  (DC1S.  4t._  ^ 

^ivity,  »aval  Plant  Eepresentativ,  office  ,S1vpEO),  and 

t e°TeP  J“  W»0,.,  The  purpose 

ct  the  guestionnaire  was  **  j * 

naire  was  . . . .o  determine  overall  DOD  buying 
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offices'  satisfaction  with  the  services  obtained  in  the 
user-custcaer  relationship." 

The  following  chart  outlines  the  organization  of  the 
overall  CASE  study  effort. 


The  purpose  of  this  paper  is  to  examine,  in  detail,  this 
third  phase  of  the  OASD  study  on  contract  administration, 
the  buying  office/requicing  activity  satisfaction  with 
contract  administration  services.  Subsequent  chapters  will 
detail  the  rationale  and  methodology  of  the  study,  the 
characteristics  of  the  participants  of  the  study,  the 
correlation  cf  the  study  participants  to  the  DOD  procurement 
workforce,  and  a general  analysis  of  the  survey  results. 
Finally,  seme  recommendations  for  further  studies  based  upon 
the  survey  results  will  be  presented. 


II.  METHOD  CF  STUDY 


A.  Seasons  foe  Selecting  Questionnaire  Method 

There  were  two  basic  approaches  for  accomplishing  the 
purpose  of  the  third  part  of  the  OASD  study.  The  first 
approach  would  have  involved  the  selection  of  a few  major 
DOD  buying  activities  and  then  the  performance  of  an 
extensive  interview  or  those  activities'  attitudes  toward 
contract  administration  services  (CAS.)  The  second  approach 
was  the  development  of  an  inclusive,  tut  generalized 
questionnaire  that  could  be  administered  at  a greater  number 
of  activities. 


The  first  approach  would  have  permitted  an  in-depth 
analysis  of  the  individuals  within  those  activities  and 
tneir  attitudes  with  follow-up  interviews  on  specific  items 
and  areas  uncovered  during  the  initial  questioning  and 
sampling.  However,  it  was  decided  that  such  an  approach 
would  permit  the  introduction  of  a sampling  bias  in  favor  of 
the  few  very  large  buying  activities.  It  may  have  uncovered 
significant  problem  areas,  but  would  have  given  undue 
attention  to  areas  characteristic  of  the  few  large  buying 
organizations  which  were  chosen.  Generalization  of  any 
findings  to  overall  DOD  buying  activities  would  have  been 
extremely  difficult. 

The  second  approach,  that  of  a questionnaire  to  sample  a 
larger  number  of  activities  and  individuals  within  those 
activities,  was  chosen.  While  this  approach  would  not 
permit,  in  the  time  available,  detailed  examination  c£  any 
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significant  problem  areas  uncovered,  it  would  provide  for  a 
broader  response  band  of  general  attitudes  and  opinions  that 
could  more  rationally  be  applied  to  all  DOD  buying 
components.  It  was  further  felt  that  such  an  approach  would 
highlight  fundamental,  recurring  type  problems  that  could  be 
characterized  as  DOD-wide  or  service- intensive.  Such  an 
approach,  using  anonymous  questionnaires,  might  also  provide 
a vehicle  fcr  receiving  suggestions  from  the  respondents  as 
, to  improvements  in  the  contract  administration  system. 

It  is  recognized  that  the  questionnaire  form  of  data 
collection  has  limitations.  In  attitude  surveys,  it  is  very 
difficult  tc  determine  the  frame  of  reference  of  tne 
respondent.  His  responses  to  the  questions  can  be  derived 
from  erroneous  eiperience  sets.  Individual  interpretation 
of  questions  and  wording  can  vary  greatly.  Gradation  of 
responses  are  difficult  to  measure.  However,  the 

questionnaire  method  is  quick,  relatively  inexpensive  and 
usually  produces  a bountiful  amount  of  data.  The  impact  of 
individual  differences  would  be  minimized  by  aggregation. 
This  second  approach  would  also  provide  a significant  data 
base  for  future  research  in  this  area  of  study,  and  permit 
concentration  and  in-depth  analysis  of  specific  problems 
areas.  Per  these  reasons,  the  questionnaire  method  was 
selected . 


9.  Design  cf  the  Questionnaire 

The  guestionnaire  was  designed  to  ootain  three  types  of 
information  and  data.  In  PAST  1,  personal  information  about 
the  respondent  and  his  background  and  experience  with 
contract  adiinistration  services  was  solicited.  This 
information  would  be  useful  in  classifying  the  respondent 
and  in  the  identification  of  any  significant  trends  among 
the  various  categories  of  respondents,  grouped  either  by 
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service,  age,  schooling,  product  line,  etc.  PAEI  2 
solicited  the  respondents'  evaluation  cf  the  various 
contract  administration  functions  performed  by  field 
contract  administration  services  (CAS)  activities.  It 
specifically  requested  their  evaluations  of  the  Defense 
Contract  Administration  Services  performance,  of  the  service 
contract  administration  activities  performance,  and  finally 
asked  whether  that  particular  function  could  better  be 
performed  by  the  buying/requiring  office.  The  third  type  of 
information  desired  was  suggestions  and  comments  from  the 
respondents.  Space  was  provided  on  each  page  of  PAST  2 for 
this,  acd  cne  paragraph  of  the  PART  2 instruction  sheet 
invited  the  participant  to  provide  this  type  of  information. 
Appendix  B contains  a sample  of  the  entire  questionnaire 
package. 

PART  2 of  the  questionnaire  was  developed  using  the  ASPP. 
1-406  (Appendix  A)  listing  of  contract  administration 
functions  as  a base-line.  The  functions  were,  in  son* 
cases,  combined,  redescribed  or  omitted.  Pifty-four 
functions  were  finally  identified  and  sub-divided  into  four 
major  functional  areas:  General  Contract  Administration, 
Production,  Quality  Assurance  and  Engineering.  In  addition, 
six  general  questions  were  added  to  each  of  the  four  major 
categories.  These  questions  concerned  the  (1)  providing  of 
advice  to  the  buying  office,  (2)  responsiveness  of  the  CAS 
component  (3)  working  relationship  of  the  CAS  component  with 
the  contractor (s)  , (4)  manning  of  the  CAS  component,  (5) 
technical  expertise  of  the  CAS  component  and  (6)  general 
overall  performance  of  the  CAS  component. 

The  questionnaire  was  designed  to  require  approximately 
30  minutes  tc  completely  answer  all  the  questions  on  each 
page.  It  was  expected  that  only  certain  respondents  with 
extensive  experience  in  contract  administration  would  be 
able  to  answer  all  questions.  Space  for  "So  Comment"  was 
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provided  for  all  evaluative  questions.  In  addition,  a block 
was  provided  at  the  top  of  each  page  of  the  evaluative 
portion  which  enabled  a respondent  to  indicate  that  he  did 
not  have  sufficient  experience  in  that  particular  category 
to  answer  any  of  the  guestions  . In  this  manner,  after 
quickly  reviewing  the  category  of  functions,  the  respondent 
could  by  checking  this  one  block  complete  the  page.  In 
cases  where  this  was  done,  the  average  time  for  completion 
of  the  questionnaire  was  reduced  to  between  approximately 
fifteen  and  twenty  minutes. 


For  the  evaluation  of  the  DCAS  and  service  contract 
administration  activities  in  PAST  2,  one  other  design 
feature  should  be  mentioned.  The  number  of  response 
categories  available  to  each  respondent  was  four  (the  "No 
Comment"  column  has  “previously  been  discussed.)  Two  of 
these  response  categories  could  be  considered  as  favorable 
responses  ("Excellent,"  "Satisfactory"),  and  two  could  be 
considered  unfavorable  ("Needs  Improvement," 
"Unsatisfactory") . The  use  of  four  categories  was  thought 
desirable  since  it  would  force  the  respondent  to  indicate  a 
favorable  or  unfavorable  attitiude.  A middle-of-the-r cad  or 
average  response  was  thereoy  discouraged. 


The  formating  of  the  the  questionnaire  was  as  follows: 


1.  Covering  ilemorandua  under  the  letter-head  of  the 

Office  cf  the  Assistant  secretary  of  Defense. 

2.  PAST  1 - Demographic  Data  sheet. 

3.  Instruction  Sheet  for  PART  2. 

4.  PART  2 - Function  Evaluation  Sheets  (4). 


C.  Preparation  and  Pretest  of  the  Questionnaire 

The  development  of  the  questionnaire  commenced  in 
September,  1 S 7 5 - In  the  next  two  and  a half  months, 
numerous  revisions  to  the  format  and  questions  were  made. 
Input  from  the  OASD  Study  Coordinator,  along  with  the 
opinions  and  suggestions  of  the  functional  team  members  were 
solicited.  Eany  of  their  recommendations  were  included  in 
the  pretest  version  of  the  questionnaire.  Since  the 
questionnaire  would  ultimately  be  distributed  to  all  the 
services,  a tri-service  pretest  sample  was  chosen.  The 
following  activities  were  used  to  pretest  the  questionnaire: 

ABMI  - Sacramento  Army  Depot,  Sacramento,  CA 

NAVI  - Kaval  Weapons  Center,  China  Lake,  CA 

AF  - Space  and-dissile  Systems  Office,  Lcs  Angeles,  CA 

The  pretest  rook  place  at  these  activities  in  late  Hovember 
19T5. 


Twenty  questionnaires  were  administered  at  each  of  the 
above  mentioned  activities.  Fifty  percent  of  the 
questionnaires  were  distributed  to  procurement  personnel. 
These  persccnel  were  categorized  as  procuring  contracting 
officers  (fCO's)  , buyers,  negotiators,  cost  analysts  and 
contract  specialists.  The  balance  of  the  quest  ion niares 
went  to  non-procurement  personnel.  These  were  the 
engineers,  technicians,  logisticians,  quality  assurance  and 
production  specialists.  While,  in  most  large  buying 
activities,  there  is  a great  disparity  in  the  numbers  of 
people  assigned  to  procurement  functions  (as  categorized 
above)  versus  non-procurement  functions,  it  was  felt  that 
the  even  split  in  the  distribution  of  the  questionnaire  was 
justified  since  the  procurement  pei-soanel  interfaced  more 
intimately  and  more  frequently  with  the  contract 
administration  components.  The  even  distribution  system  was 
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ultimately  followed  in  the 
guesticnnaire. 


administration  of  the  final 


eaohSi"C!  ‘"I  9UeSti0nDaite  *0  K«  self-erplanatcry,  at 
° tiS  pretest  activities  the  questionnaire  was 
istrrontsd  without  verbal  instructions  to  the  participants, 
f er  an  appropriate  interval  (one  to  two  hours)  , each 
lcipant  was  asked  to  return  the  questionnaire  to  one  of 

reactionist 1 'T  ’e“berS-  kt  this  ti>e-  the  respondent's 

solicited  ! ab°Ut  ^stiounaire  «» 

iicited.  specific  questions  were  provided  to  each 

aater.ie.er  to  insure  coverage  of  all  the  appkabl! 
eatures  of  the  questionnaire.  Those  questions  included  the 
questionnaire  format.  length,  understandibility  and 
wording/guestion  ambiguities.  other  comments  and 
suggestions  for  improvement  were  also  solicited. 

As  a result  of  the  pretesting  and  the  ccmments  received 
various  changes  were  made  and  the  guestionnaire  pacj  ^ 
revised  into  its  final  form.  (Append!*  3, 

D.  Ccmpilaticn  of  Distribution  lists 


Chant -r  r -1“3t  fhaS6  °£  ^ °iS0  Stud7  rationed  in 

Chapter  I.  runctional  teams  visited  various  oontract 

Po  e."1,  s'”  aCti,ttiis'  dray,  „avy  and  Air 

Poroe.)  suoseguent  to  these  visits,  these  field  activities 

-ere  requested  to  provide  the  OASD  teams  with  iists  of  the 
tea  buying  offices  who  were  their  major  users  in  terms  If 
number  of  contracts  and  dollar  value  rir._ 

lists  a*  -rr  , Up0D  receiP*  of  these 

lists,  an  array  of  the  user  activities  by  service  wa- 

constructed.  Pach  ti.e  an  activity  was  listed  by  one I,  r 
rnna._._i.  , . . 1 cy  one  cf  the 

Ustilo  d’1°lS'CaUo“  ‘^animations,  it  was  recorded  on  a 
ting.  it  was  then  determined  subjectively  that  five  or 

‘Hr  ^ eaCh  '°“ld  «. 

sn  activities  most  often  listed  for  each  cf  the 
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services  were  then  selected.  In  the  case  of  DSA,  the 
activities  icst  often  listed  were  selected.  Kith  these 
parameters,  a sample  size  of  between  eighteen  and  twenty-one 
activities  (for  the  three  services  and  DSA)  would  be 
available.  Ihis  number  of  activities  would  be  within  the 
financial  and  time  constraints  in  existence,  would  be  a 
manageable  sample  and  should  provide  a good  cross-section  of 
the  buying  offices'  attitudes  in  the  Department  of  Defense. 
This  sample  also  avoided  the  danger  of  concentration  of  the 
study  in  ocly  one  or  two  large  activities  and  a sample  of 
attitudes  based  on  circumstances  unique  to  them. 

In  planting  the  questionnaire  effort,  it  was  originally 
envisioned  that  employee  lists  would  be  obtained  from  the 
selected  activities.  Selection  of  employees  (using  an  even 
division  between  procurement  and  non-procurement  personnel) 
would  he  accomplished  by  use  of  a random  number  table.  The 
questionnaires  would  then  be  mailed  to  the  selected 
individuals  directly,  and  subsequently  returned  to  the  Naval 
Postgraduate  School  for  processing.  Historically,  a return 
rate  of  between  25%  and  35%  of  mailed  questionnaires  is 
generally  experienced.  Based  on  the  fact  that  tne  covering 
memorandum  from  OASD  would  highlight  the  importance  of  the 
effort,  a return  rate  of  approximately  SOS  was  anticipated 
to  be  reasonable.  Therefore,  a printing  of  1,000 
questionnaire  packages  was  requested.  The  printing  of  1,000 
was  felt  to  provide  a sufficient  number  so  that  the  sample 
would  be  significant,  yet  be  manageable,  with  a 50%  return 
rate,  a sample  of  500  responses  would  be  available  for 
analysis . 

A prcblei  arose,  however,  in  the  plan  to  mail  the 
questionnair es.  Circumstances  evolved  which  precluded  the 
mailing  of  the  questionnaires  and  an  altercate  approach  was 
developed.  In  this  approach,  the  user  activities  to  be 
sampled  were  divided  into  three  groups.  Each  member  cf  the 
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questionnaire  development  team  would  take  one  group  of 
activities,  and  in  the  space  of  a two  week  period, 
administer  the  questionnaire  at  each  of  his  activities.  He 
would  also  collect  them  from  the  participants  prior  to  his 
departure  frcm  the  activity.  Three  main  benefits  from  this 
approach  were  envisioned.  First,  the  time  requirement  would 
be  considerably  shortened.  The  questionnaires  would  be 
distributed,  returned  and  be  available  for  processing  within 
a two  week  period.  Secondly,  the  return  rate  would  be 
considerably  greater  than  the  50*  originally  estimated.  The 
third  benefit  would  come  from  the  ability  of  the 
questionnaire  administrator  to  interface  directly  with  the 
command  beinc  sampled  and  avoid  the  possible  distribution  of 
questionnaires  to  biased  and/or  otherwise  ncn-responsi ve  (by 
virtue  of  their  }ob)  personnel.  It  would  also  enable  the 
administrator  tar  handle  unexpected  circumstances  such  as 
alternate  selection  of  respondents  in  the  absences  of  the 
selected  respondents. 

Hith  the  printing  of  1,000  questionnaires,  it  was 
decided  that  274  would  be  allocated  to  each  service  and  an 
allocation  of  130  questionnaires  would  be  made  to  the 
Defense  supply  Agency  (DSA)  buying  activities.  No  DSA 
activity  actually  received  sufficient  mention  in  the 
listings  cf  user  activities  to  qualify  for  inclusion  in  the 
original  selection.  However,  it  was  decided  that  the 
questionnaire  would  not  accurately  sample  DOD-wide  buying 
activities  unless  they  were  included. 

The  274  questionnaires  for  each  service  were  allocated 
to  each  activity  based  on  the  proportion  cf  times  they 
appeared  cn  the  contract  administration  activities'  users 
listings.  The  DSA  questionnaires  were  allocated  to  three 
DSA  activities  by  roughly  equating  them  with  a Havy 
Inventory  Control  Point  (ICP.)  The  Defense  Personnel 
Support  Center  (DPSC)  Philadelphia  was  allocated  a 
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proportionately  greater  amount  than  the  other  two  DSA 
activities.  CPSC  handles  three  very  different  commodities  - 
clothing/textiles,  medical  and  provisions.  Provisions  are 
so  unigue  that  they  were  deleted  from  the  questionnaire 
effort.  Egual  allocations  were  then  provided  for  the 
clothing/textile,  and  the  medical  categories. 

Table  1 provides  a summary  of  the  activities  sampled  by 
service,  including  the  percentage  of  time  they  appeared  on 
the  user  listings  received,  and  the  number  of  questionnaires 
allocated  to  each  activity.  (Some  minor  errors  are  in  the 
table  due  to  roundinq  and  an  attempt  tc  allocate  the 
questionnaires  to  each  activity  in  even  numbers.) 

TABLE  1 


Service 

ARMY 


NAVY 


Distribution  of  Questionnaires 


Activity 
ASC  St  Louis 
ECOH  Ft  Mommouth 
Bedstone  Arsenal,  AL 
Missile  Command,  AL 
EMDS  Command,  AL 

NAVAIE  Hash  DC 
NAVSZA  Hash  DC 
A30  Philadelphia 
SPCC  Mechanicsburg 
NAVELEX  Hash  DC 


% on  Number  cf 

Listing  Questionnaires 


41 X 

112 

24* 

66 

15* 

42 

12* 

32 

§2 

22 

100* 

274 

37* 

102 

25* 

68 

13* 

36 

13* 

36 

m 

32 

100* 

274 

19 


mm i* 


A.  F. 


CS  A 


ASD  Dayton 

44% 

120 

BASSO  Los  Angeles 

15% 

42 

ALC  Warner  Bobbins 

12% 

32 

ESD  Hanscom,  HA 

12% 

32 

ALC  San  Antonio  TX 

10% 

26 

ALC  Oklahoma  City 

73 

22 

100% 

274 

EESC  Philadelphia 

60 

EESC  Dayton 

36 

CCSC  Columbus 

34 

130 

Total  Questionnaires 

952 

J 


E.  Administering  the  Questionnaire 

The  questionnaires  were  administered  to  the  selected 
activities  within  a three  week  period  in  the  middle  of 
January  1S76. 

Each  user  activity  to  be  visited  was  requested  to 
provide  the  name  of  a contact  point  for  the  questionnaire 
administrator.  By  telephone,  these  individuals  were  briefed 
on  the  purposes  of  the  questionnaire  and  its  part  in  the 
overall  QASD  study.  The  number  of  questionnaires  to  be 
distributed  at  that  activity  and  the  method  of  distribution 
were  discussed.  Each  contact  was  requested  to  have 
available  if  possible,  employee  (both  military  and  civilian) 
listings  cf 

(a)  all  personnel  within  the  procurement  field,  and 
(t)  all  personnel  outside  the  procurement  field. 

Both  groups  were  to  be  familiar  with  one  or  more  cf  the 
functional  areas  cf  the  questionnaire  (General  Contract 
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Administration,  Production,  Quality  Assurance  or 
Engineering.)  It  was  recognized  that,  such  a listing  might 
preclude  a completely  random  sample  of  questionnaire 
participants.  However,  with  the  limited  number  of 
questionnaires  available,  it  was  felt  that  more  meaningful 
data  would  be  obtained  by  structuring  the  sample  to  exclude 
those  individuals  who  might  not  provide  a useful  input  to 
the  study.  The  selection  of  participants  would  still  be 
made  from  the  listings  of  qualified  personnel  utilizing  a 
complete  random  selection. 

With  this  vavance  contact  made,  the  procedure  followed 
at  each  activity  was  essentially  the  same  for  the  three 
questionnaire  administrators.  In  the  morning  of  arrival  at 
the  user  activity,  the  administrator  would  usually  explain 
the  questionnaire  to  the  point-of-contact  individual  and 
others  within  the  command  whose  subordinates  would  be 
involved  in  the  questionnaire  effort.  Next,  the  two  lists 
of  employees  were  examinined  and  by  the  use  of  a random 
number  table,  the  appropriate  sample  was  selected.  In 
addition,  a number  of  alternative  individuals  were 
designated.  Ihe  questionnaires,  with  envelopes  number- 
coded  for  control  purposes,  were  then  distributed  to  the 
selected  individuals.  In  geographic  areas  with  acre  than 
one  user  activity,  the  administrator  would  then  establish  a 
return-time  later  in  the  day,  and  proceed  to  repeat  the  saaa 
procedure  at  the  next  activity. 

The  participants  received  the  questionnaires  at  their 
desks  and  were  reguested  to  have  them  completed  within 
usually  the  next  four  to  five  hours.  This  approach  was  felt 
to  be  preferable  to  having  all  the  selected  participants 
assemble  in  a conference  room  at  a pre-arranged  time  and 
complete  the  questionnaire  while  assembled.  Not  only  would 
it  be  extremely  difficult  to  assemole  all  the  individuals  on 
such  short  notice,  but  it  was  felt  that  certain  group 
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pressures  (to  finish  first,  not  to  finish  last,  etc.)  would 
bias  the  responses  to  the  questions.  Completion  of  the 
questionnaire  in  the  individual's  own  work  environment, 
within  an  ample  time  period,  was  thought  to  provide  a more 
conducive  atmosphere  for  meaningful  response. 

At  the  previously  established  time,  the  questionnaire 
administrator  returned  to  collect  the  completed 
questionnaires.  At  this  time,  it  was  originally 
contemplated  that  the  administrator  would  be  available  for 
interviews  with  any  respondents  desiring  to  amplify  or 
comment  cn  the  questionnaire.  Unfortunately,  time  did  not 
permit  this  interview  procedure, 

F.  Heturns  received 

As  was  reported  previously,  952  questionnaires  were 
distributed  to  19  different  Department  of  Defense  buying 
activities.  Cf  this  amount,  25  were  not  returned  and  9 were 
rejected  due  to  incomplete  or  missing  data.  The  percentage 
of  return  was  96. which  is  considerably  higher  than  the 
historical  percentage  of  returns  on  mailed  questionnaires. 
Table  2 summarizes  the  returns. 

TABLE  2 

Returns  Received 


Questionnaires  Distributed 
Questionnaires  Not  Returned 

25 

952 

Questionnaires  Rejected 

_3« 

Questionnaires  Returned 

918 

Percentage  of  Return 

\,6.4* 
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G.  Processing  the  Returns 

4 

Upon  receipt  of  a completed  questionnaire,  the  five 
pages  were  first  narked  with  the  three  digit  numerical  code 
from  the  questionnaire  envelope  to  insure  that  the 
attitude/cpirion  responses  were  correctly  identified  with 
the  demographic  data  sheet.  The  questionnaire  was  then 
edited  for  obvious  mistakes  and  errors.  Where  a response 
area  had  been  left  blank,  the  question  was  edited  with  a "No 
Comment"  response. 

Upon  completion  of  editing,  the  questionnaires  were  then 
processed  through  an  OPSCAM  Model  17  3eader  and  an  IBM  card 
data  deck  was  produced.  Each  questionnaire  package  was 
coded  into  5 data  cards.  The  data  deck  was  then  verified  to 
insure  its  accuracy  with  the  actual  questionnaire  responses. 
Once  this  was  done,  the  data  deck  was  read  onto  a tape  for 
ease  of  processing. 

The  Statistical  Package  for  the  Social  Sciencies  (SPSS) 
was  used  fcr  processing  the  data.  It  is  an  integrated 
system  of  computer  programs  designed  for  the  analysis  of 
social  science  data.  These  programs  were  available  for 
call-up  in  the  W.  B.  Church  Computer  Facility  at  the  Naval 
Postgraduate  School  utilizing  an  I3H  360/67  computer.  Of 
the  many  SPSS  procedures  available  for  analysis  of  data, 
simple  frequency  distributions  and  crosstabulations  with 
specific  descriptive  statistics  were  the  primary  programs 
used. 
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III.  CHARACTERISTICS  OF  THE  RESPONDENTS 


This  chapter  summarizes  the  analysis  performed  on  the 
demographic  portion  of  the  questionnaire.  Appendix  C with 
Tatles  C * 1 to  C * 4 , contains  additional  statistics  on 
the  characteristics  cf  the  questionnaire  respondents. 

A.  Type  cf  Activity 


The  types  of  activities  sampled  are  shown  in  Table  3. 

TABLE  3 


Type  Of  Activity 


Category 

Respondents 

Percentage 

Systems  Command 

3B6 

4 2* 

Buying  Activity 

297 

32* 

Sequiring  Act/Prog  Office 

105 

1 IX 

Inventory  Control  Point 

71 

ex 

Stock  Pcint-Dtpct-Center 

45 

sx 

Other 

_14 

a* 

918 

10CX 

Respondents  in  Systems  Commands  and  Buying  Activities 
dominated  the  sources  of  respondents  with  almost 
three-quarters  of  the  sample  ccming  from  that  population. 
This  distribution  was  in  line  with  the  characteristics 
desired  cf  the  sample.  It  was  felt  that  while  a greater 


24 


percentage  cf  contractual  actions  are  relatively  lew  dollar 
value,  approximately  90%  of  the  dollars  are  spent  in  the 
larger  dcllar  value  procurements  accomplished  in  these  two 
types  of  activities.  It  was  the  intent  of  the  questionnaire 
to  measure  the  attitudes  of  personnel  doing  the  larger 
procurements  with  the  greater  defense  dollar  impact. 

B.  Service  cf  the  Activity 


It  was  originally  decided  that  an  even  distributicn  of 
the  guestiennair es  among  the  three  services  would  be 
attempted  with  an  arbitrary  figure  of  130  questionnaires 
being  distributed  to  the  DSA  activities.  The  results  of 
questionnaire  distribution  are  shown  in  Table  4. 


TABLE  4 

Service  Distribution 


Serjise 

Army 

Navy 

Air  Force 
ESA 


Allocated 

Returned 

Percentage 

274 

253 

92.3% 

274 

254 

92.7’ 

274 

279 

101.8% 

110 

m 

98.5% 

952 

914 

96.0% 

In  the  case  of  the  Air  Force,  four  questionnaires  over  the 
allocated  amount  were  returned.  This  was  due  tc  the 
recovery  of  questionnaires  that  had  been  allocated  and 
distributed  as  alternates  in  case  of  employee  absentees  at 
the  time  of  administration.  Four  individuals  returning  che 
questionnaire  had  marked  ’'Other1*  as  *ne  service  of  the 
activity.  8ith  these  responses  included,  918  of  952 
questionnaires  were  returned  for  a rate  of  return  of  56.4%. 


25 


•s*-* 


C.  Service  cf  the  Bespondents 


Of  the  918  participants,  124  or  13.5*  were  in  the 
military  service  and  794  or  86.5*  were  civil  service 
personnel.  Table  5 provides  acre  detailed  information. 

TABLE  5 


Service  of  the  Bespondents 


Service 

Bespondents 

Percentage 

Cumulative 

Percentage 

Army 

24 

2.6* 

2.6* 

Havy 

30 

3.3* 

5.9* 

Air  Force 

.7.0 

7.6* 

13.5* 

Civil  Service 

m 

100.0* 

918 

. 100.0* 

0.  Bank  and  GS  Bating  of  the  Bespondents 

1 little  oter  60*  of  the  respondents  tc  the 
questionnaire  were  of  the  Sa Jor/Lieutenant  Commander  or 
GS- 12  civil  service  grade  or  lower.  Important  in  this 
statistic  is  che  belief  that  the  sample  was  composed 
primarily  cf  personnel  at  the  working  level  of  the 
organizations  visited.  The  individuals  who  evaluated  the 
contract  administration  functions  were  felt  to  'le  those  with 
hands-on  experience  and  who  possessed  the  necessary  working 
knowledge  of  the  contract  administration  components.  Table 
6 furnishes  the  detailed  anal^is  of  the  rack  and  GS  rating 
structure  of  the  sample. 
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TABLE  6 


Bank  and  GS  Bating 


Category 

0-2,  GS  1C  and  below 
C-3,0-4,  GS  11-12 
0-5,  GS  13-14 
0-6,  GS- 15 


Respondents 

149 

414 

303 

50 

916 


Percentage 

16% 

45% 

33% 

65 

100% 


Two  respondents  indicated  the  category  “Other"  in  their 
responses. 


E.  Age  cf  the  Bespondents 


Apprcziaately  two-thirds  of  the  respondents  were  under 
50  years  of  age.  The  greatest  nuaber  of  respondents  were  in 
the  age  grcup  of  41  - 50  years  which  represented  33%  cf  the 
saaple.  Ihe  aiddle  categories  of  age  (31  - 60)  acccunted 
for  84%  cf  the  saaple.  In  Table  7,  a detailed  analysis  is 
provided. 


TABLE  7 


Age  of  the  Bespondents 


lie  Category 
20  - 3C 
31  - 40 
41  - 5C 
51  - 60 
Over  60 


Bespondents 

108 

204 

306 

264 

is 

917 


12% 

22% 

33% 

29% 


21 

100% 
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One  respondent  did  not  nark  tills  category  of  the 
guestionnaire. 

F.  Supervisor  Status 


256  respondents  (23%)  indicated  that  they  were 
supervisors,  while  662  (72%)  indicated  that  they  were  not. 
Of  the  participants  indicating  that  they  were  supervisors. 
Table  8 provides  a breakdown  of  the  number  of  enployees 
supervised.  Two  respondents  who  indicated  supervisor 
status,  did  not  indicate  the  nuaber  of  enployees  supervised. 
There  is  a fairly  even  distribution  among  the  categories  of 
the  nuaber  of  people  supervised. 


TABLE  8 

Nuaber  of  Employees  Supervised 


flunber  oj  Enployees 
t to  5 
6 to  10 
11  tc  20 
Over  20 


aespondents 

68 

64 

72 

254 


Percentage 

27% 

25% 

28% 

20% 

100% 


G.  Education  Level 


61%  cf  the  respondents  stated  that  they  were  college 
graduates.  Table  9 shows  the  education  distribution  cf  the 
guestionnaire  sanple. 
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TABLE  9 


Education  Level  of  Respondents 


Sltegoil 
Sigh  School 
Soae  College 
College  Graduate 
Soae  Graduate  Hcrk 
Graduate  Degree 


Respondents 

125 

235 

237 

180 

H2 

916 


Percentage 

13% 

26% 

26% 

20% 

m 

100% 


Tvo  individuals  did  not  respond  to  this  question 
H.  Experience  Level  of  the  Respondents 


The  experience  level  of  the  respondents  was  aeasured  in 
two  ways.  First,  the  experience  level  in  the  respondents' 
present  assignaent  was  solicited.  Secondly,  the 
respondents'  total  procureaent  related  experience  was 
sought. 

Approxiaately  50%  of  the  respondents  had  5 years  or  aore 
experience  in  their  present  assignaenc  and  less  tnan  1C%  had 
been  in  their  current  job  for  less  than  one  year.  As  far  as 
the  total  procureaent  related  experience  is  concerned,  76% 
had  over  5 years  or  aore  of  experience  and  less  than  5%  had 
under  one  year  of  procureaent  related  experience.  Tables 
C - \ and  C - 2 in  Appendix  C provide  the  detailed 

statistical  analysis  of  the  experience  category. 

I.  Product  Specialty 


Nine  product  categories  were  available  for  respondent 
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consideration.  In  addition,  an  "Other"  category  was 
provided  in  order  to  provide  a response  band  for  all 
questionnaire  participants.  46%  of  the  respondents  were 
involved  in  the  aircraft  and  missile  product  areas,  while 
the  electronics  area  captured  alaost  25%  of  the  saaple.  The 
reaaining  product  categories  represented  froa  7%  (Services) 
to  less  than  1%  (Electrical)  of  the  saaple.  A detailed 
breakdown  is  provided  in  Table  C - 3 of  Appendix  C. 

J.  Types  of  Erocureaent 


Sr 

s 


82.4%  of  the  respondents  indicated  that  the  negotiated 
procurement  was  aost  frequently  encountered.  This 
represented  756  of  the  918  respondents.  Table  10  provides 
the  data. 


TABLE  10 


Type  Procurement  host  Encountered 


Category 

Respondents 

Percentage 

Negotiated 

756 

82.4% 

Formally  Advertised 

m 

17.6% 

918 

100.0% 

The  respondents  were  asked  to  indicate  the  contract  type 
aost  often  encountered,  fixed  price  type  contracts  were 
aost  often  encountered  by  69%  of  the  respondents, 
cost-reiaturseaent  contracts  by  29%  and  other  instruaents 
such  as  Basic  Ordering  Agreements  by  2%.  Table  11  and  Table 
C-4  in  Appendix  C provide  a more  extensive  breakdown  cf  the 
responses. 
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TABLE  11 


Type  Contract  Host  Encountered 


Category 
Fixed  Erice 
Cost  Beiaburseaent 
Other 


Respondents 

633 

262 

23 

918 


Percentage 

69% 

29% 

25 

100% 


The  nuaber  of  contracts  encountered  in  a year  ana  the 
average  dclJar  value  per  contract  are  closely  related. 
Table  12  outlines  the  two  characteristics  in  the  study 
saaple. 

TABLE  12 

Huaber  and  Average  Dollar  Value  of  Contracts 


£$iU2££  Aierage  jjoljar  Value 


Cat^gou 

ffiiond 

Percent 

Category 

Respond 

Percent 

Under  5 

227 

25% 

Over  J5H 

241 

26% 

5-10 

118 

13% 

$1  - 5H 

129 

14% 

11  - 20 

113 

12% 

$.5  - IS 

87 

10% 

21  - 50 

127 

14% 

$.1  - .515 

156 

17% 

Over  50 

m 

m 

Onder  S.lfl 

■MI 

33* 

918 

100% 

918 

100% 

K.  Contract  Adainistration  Coaponent  Utilization 

Table  13  provides  a general  breakdown  of  the 
respondents4  utilization  of  the  various  contract 


31 


administration  agencies.  The  figures  represent  the  number 
of  respondents  utilizing  the  contract  administration 
services  provided  by  the  indicated  agency.  In  the  table, 
many  respondents  indicated  that  they  utilized  more  than  one 
CIS  organization.  The  percentage  figure  is  the  number  of 
individuals  indicating  they  used  the  corresponding  C&S 
organizaticn  in  relation  to  the  total  respondents  to  the 
questionnaire.  (918) 


TABLE  13 

Utilization  of  CAS  Services 


Component 

Respondents 

Percentaqe 

OCAS 

821 

89% 

Army 

- -• 

240 

26% 

Navy 

437 

48% 

Air  Force 

496 

54% 

Euying  Office 

564 

61% 

Other 

79 

9% 

Of  the  respondents  using  OCAS  for  contract 
adeinistraticn  services.  Table  14  furnishes  an  analysis  on 
the  percentage  of  utilization. 


TABLE  14 


Utilization  of  DCAS 


Category 
0 - 25  X 
26  - 50* 
51  - 751 
76  - 100X 
Unknown 


fiespondents 

208 

108 

113 

307 

85 

821 


isiceijt&ge 

25X 

13X 

14X 

3855 

IPX 

100X 


Lesser  numbers  of  respondents  indicated  thar  ♦ 
»di,laual  ssrTice  -pUnt  off  ,cas  tei  **«  «>«T  ««4 

indicating  otilization  of  the  «di.idaals 

administration  activities  -n  k.  service  contract 

**  the  ir.y  PUn  I Ues  ^le  — - 

*•«.  17  for  the  ' 8 " ^ the  «”*>•  - 


TABLE  15 

utilization  of  lray  Plant  infinities 


0 - 25X 
26  - 50  X 
51  - 751 
76  - 100X 
Ookncwn 


jLg$pQfl4ents 

128 

23 

20 

27 

02 

240 


Percentage 

53X 

10X 

8X 

11X 

181 

100X 
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TABLE  16 


Otilization  of  the  HAVPROs 


£lte3ori 

0 - 25  X 
26  - 50% 
51  - 75% 
76  - 10C1 
Unknown 


Respondents 

270 

49 

19 

28 

71 

437 


Percentage 

62X 

11* 

4% 

7% 

164 

100% 


TABLE  17 

Otilization  of  the  AFPROs 


£&tS£0£? 

g35£2Rflents 

Percentage 

0 - 25% 

297 

60% 

26  - 501 

62 

12% 

51  - 751 

20 

4% 

76  - 10C1 

53 

11% 

Unknown 

64 

114 

496 

100% 
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17.  AN  ANALYSIS  OF  TM  SAMPLE 


This  chapter  describes  the  four  areas  of  analysis 
performed  on  the  responses  to  the  questionnaires.  Part  1 
compares  selected  characteristics  of  the  questionnaire 
respondents  to  those  sane  characteristics  in  the  DOD 
procurement  workforce.  Part  2 examines  the  relationship 
betweeu  the  overall  rating  given  to  each  of  the  four  general 
categories  as  indicated  by  responses  to  the  question, 

"Overall,  I would  rate  the  performance  of  the  , „ 

component  as:",  and  the  responses  of  the  participants  to  the 
individual  functions  within  those  general  categories.  Part 
3 discusses  the  influence  of  certain  demographic 
characteristics  on  the  responses  to  the  overall  ratings  for 
each  of  the  four  general  categories.  Finally,  Part  4 
compares  the  overall  ratings  given  to  OCAS  and  the  Plant 
Ccgnizance  activities  in  each  of  the  functional  areas  to 
determine  if  there  exists  a significant  difference  in  the 
ratings.  Conclusions  based  upon  this  analysis  are  given  in 
Chapter  7.  In  addition,  two  appendices  contain  detailed 
frequency  distributions.  Appendix  G reflects  the  total 
results  cf  the  survey  for  the  demographic  characteristics  of 
the  respondents  and  their  answers  to  the  questions  in  each 
category.  The  absolute  frequencies  and  their  relative 
frequency  percentages  are  given  for  each  response.  Those 
cases  in  which  the  respondent  did  not  answer  a question  or 
indicated  "No  Comment"  were  identified  as  nissing  values. 
As  such,  they  are  not  included  in  the  adjusted  frequency 
percentages.  Appendix  H contains  the  total  results  obtained 
for  each  cf  the  categories  after  adjusting  the  responses 
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into  a favcrable/unf avorable  categorization  as  noted  in 
Chapter  II,  Part  B. 


Part  1 


In  this  first  part,  five  characteristics  of  the 
questionnaire  sample  are  examined  with  regards  to  the  same 
characteristics  that  are  present  in  the  Department  of 
Defense.  The  characteristics  examined  are  Age,  Experience 
Level,  Bank/GS  Bating  Level,  Type  of  Procurement  and  Type  of 
Contract  Host  Encountered.  Data  for  the  Department  of 
Defense,  uclcss  otherwise  noted,  was  obtained  from  three 
sources:  OASD  (I  and  L)  , Beport  of  the  Long  Bange  Manpower 
Policy  Board,  February  1969,  OASD  (Comptroller),  Hilitary 
Prime  Contract  Awards,  Fiscal  Tear  1975  and  The  Beport  of 
the  Commissicn  cn  Government  Procurement,  December  1972.  It 
is  recognized  that  the  sources  of  data  pertaining  to  the 
characteristics  of  personnel  in  the  procurement  workforce 
cover  the  entire  workforce,  including  the  contract 
adiinistraticn  component.  The  questionnaire  sample  did  not 
contain  this  component.  This  factor  was  considered  when 
drawing  conclusions  from  the  analysis. 

The  statistical  measure  used  in  this  part  is  the 
Chi-Square  (2x2)  , goodness  of  fit  test.  It  is  utilized  to 
determine  whether  the  questionnaire  sanple  was  selected  from 
the  DOD  population  with  a certain  probability  distribution. 
Hith  this  measure,  the  frequency  distribution  for  our  sample 
is  compared  with  the  frequency  distibution  expected  if  the 
DOL  population  probability  distribution  exists.  This  use  of 
the  Chi-Square  is  analogous  to  the  use  of  the  t-test  tc  test 
hypotheses  concerning  & population  mean.  Chi-Square  is 
defined  as: 
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where  0*t  represents  the  observed  frequencies  and  E;  the 
expected  frequencies. 

Before  using  the  Chi-Square  test,  certain  conditions  and 
assumptions  must  be  satisfied.  First,  one  must  assume  that 
random  sampling  was  used  in  obtaining  the  sample.  In 
Chapter  III,  the  use  of  random  number  tables  to  chose  sample 
participants  was  detailed.  Secondly,  the  observations 
should  te  independent  of  each  other.  Again  in  Chapter  III, 
the  method  of  questionnaire  administration  was  discussed. 
Besponses  to  the  questionnaire  were  accomplished  by  each 
participant  in  his  or  her  own  work  area,  independent  of  any 
other  respondent.  Thirdly,  each  expected  frequency  should 
be  greater  tbac  one.  In  making  the  computations,  some 
collapsing  and  grouping  of  response  categories  might  be 
undertaken  to  satisfy  this  condition.  Lastly,  the  sum  • of 
the  observed  frequencies  and  the  sum  of  the  expected 
frequencies  should  be  equal.  In  arriving  at  the  OOD 
population  frequencies,  data  from  the  three  aforementioned 
reports  was  converted  from  a frequency  figure  to  a 
percentage  and  this  percentage  was  then  applied  to  the 
number  of  respondents  in  the  sample  for  that  characteristic 
to  obtain  the  expected  population  frequencies.  For  example, 
in  the  case  of  Type  of  Procurement,  the  data  source  (FI  1975 
Silitary  Prime  Contract  Awards  ) stated  that  87. 1%  of  the 
total  proccrement  dollars,  less  Intragovsrnmental 
procurements,  wore  negotiated,  and  12. 3*  were  advertised. 
Application  of  these  percentages  to  the  sample  total  of  918 
yields  the  figures  of  805  and  113  for  negotiated  and 
formally  advertised  procurements  respectively.  The  sane 
method  was  applied  to  the  other  four  characteristics  while 
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using  the  available  data  sources. 


An  alpha  ( at.  ) level  of  .05  was  used  and  values  for 
designating  the  critical  region  are  presented  for  each 
characteristic  exaained.  In  all  cases  the  null  hypothesis 
tested  was  that  the  saaple  selected  (for  that  particular 
characteristic}  was  representative  of  the  DOD  population. 
The  alternate  hypothesis  was  that  the  saaple  selected  was 
not  representative  of  the  000  population. 

s 

A.  Age 


Table  13  shows  the  Observed  and  Expected  frequencies  for 
four  age  categories.  The  source  of  the  expected  data  is  the 
Beport  of  the  Coaaission  on  Governnent  Procureaent. 


TABLZ  18 
Age  Frequencies 


Category 

Observed 

Expected 

20  - 30 

108 

98 

21  - 40 

204 

188 

41  - 50 

306 

3C5 

51  and  cider 

ili 

m 

917 

917 

For  3 degrees  of 

freedoa  and  ©c 

equal  tc 

Chi-Square  critical  region  is  defined  as  7.02  to  infinity. 
The  Chi-Square  for  Age  equals  4.62,  and  one  fails  to  reject 
the  null  hypothesis  that  the  saaple  selected  was 
representative  of  the  DOD  population  with  regards  tc  its 
age. 
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Since  the  expected  values  are  derived  from  too 
procurement  workforce  in  1971,  some  shirting  of  frequencies 
in  the  intervening  years  to  the  tine  of  the  O&SD  survey 
would  be  expected.  However,  the  shifting  of  individuals 
would  most  likely  be  into  the  younger  age  group,  through  the 
other  groups  and  out  of  the  oldest  age  category.  Such  a 
shift  would  lend  itself  to  a better  fit  tc  the  observed 
frequencies. 

B.  Procurement  Belated  Experience  Level 


Table  19  indicates  the  frequencies  for  the  procurement 
related  experience  level  of  the  population  and  saaple 
respondents.  source,  data  is  from  the  Beport  of  the 
Commission  on  Government  Procurement. 

TABLE  19 

Procurement  Belated  Experience  Frequencies 


£§lS £211 

2feae£ved 

Expected 

Less  than  1 yr 

39 

75 

1 - 5 yrs 

18.: 

259 

5-10  yrs 

168 

219 

10  - 20  yrs 

346 

266 

Over  20  yrs 

m 

n 

918 

918 

For  4 degrees  of  freedom,  <X  equal  to  0.05,  the  Chi-Square 
critical  regicn  is  defined  as  9.49  to  infinity.  The 
Chi-Square  value  for  procurement  related  experience  is 
147.94  and  the  null  hypothesis  that  the  simple  selected  was 
representative  of  the  000  population  with  regards  to 
procurement  related  experience  is  rejected. 
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It  should  again  be  pointed  out  that  the  source  of  the 
observed  data  is  dated.  Shifts  in  the  expected  frequencies 
would  be  expected,  bub  would  be  difficult  to  predict. 
However,  the  observed  and  expected  frequencies  do  follow  the 
sane  aisodal  pattern  with  peaks  at  the  1 to  5 year  and  the 
10  to  20  year  categories.  While  the  frequencies  are  not 
statistically  alike,  they  do  possess  soae  siailar 
characteristics. 


0.  Bank  and  OS  Bating 


fable  20  provides  tho  data  concerning  the  observed  and 
expected  frequencies  for  the  rank  and  GS  ratings  of  the 
sasple  and  hypothesized  population.  Source  of  the  expected 
frequencies  is  the  1969  H&npcwer  Report. 


TABLE  20 

Bank/GS 

- Bating  Frequencies 

Ssisaau 

Observed 

IlBgctefl 

C-2,  GS-10  and  below 

149 

433 

0-3,4,  GS  11-12 

414 

378 

C-5 , GS  13-14 

303 

96 

0-6,  GS- 15  and  above 

5° 

2 

916 

916 

For  3 degrees  of  freedos,  and  CK 

equal  to 

0.05,  the 

Chi-square  critical  region 

is  defined  as 

7.82  to 

infinity. 

The  Chi-Square  value  for 

the  rank/GS 

rating 

level  is 

extresely  large  and  the  null  hypothesis  that  the  sasple  was 
representative  of  the  000  population  with  regards  to  rank/GS 
rating  is  rejected.  However,  it  should  be  sentioned  that 
the  source  data  for  the  expected  frequencies  is  fcr  the 


40 


civilian  ccaaunity  only  and  is  derived  from  the  1969  Eeport 
of  the  Long  Bange  Logistics  Manpower  Policy  Board. 

D.  Type  Of  Procurement 

is  opposed  to  the  characteristics  of  the  sample  and 
population  individuals,  two  aeasures  of  the  characteristics 
of  the  business  being  done  by  the  questionnaire  respondents 
were  exaai  i.  These  two  areas  were  the  type  cf  procurement 
(negotiat  d cr  foreally  advertised)  and  the  type  of  contract 
utilized  (ccst-reiabursable  or  fixed  price.)  Other 
characteristics  such  as  the  average  dollar  value  per 
contract  cr  the  average  nuaber  of  contracts  experienced 
during  a year,  were  considered  to  be  possibly  confusing  and 
subject  tc  aabiguous  interpretation  by  the  respondents. 
Type  of  procureaent  and  type  of  contract  were  considered  to 
be  clear-cut  and  understandable  to-  all  questionnaire 
participants.  Comparison  of  the  saaple  figures  to  those 
representing  D00  procureaent  actions  were  felt  to  be  aaong 
the  nost  accurate  tests  of  saaple  to  population  validity. 

Table  2 1 provides  the  frequencies  on  the  type  of 
procureaent  experienced.  Source  data  for  the  expected 
frequencies  in  both  Tables  21  and  22  is  derived  froa  Fiscal 
Tear  1975  Military  Prise  Contracts  Awards  report. 

TABLE  21 


Procureaent  Type  Frequencies 


Salegopj 

Observed 

Expected 

negotiated 

756 

805 

Formally  Advertised 

m 

m 

918 

918 

I 
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Foe  1 degree  of  freedom  and  & equal  to  0.05,  the 

Chi-Square  critical  region  is  defined  as  3.84  to  infinity. 
The  Chi-Square  value  for  saaple  procureaent  type  is  24.23, 
and  the  null  hypothesis  that  the  saaple  selected  was 
representative  of  the  000  population  with  regards  to 
procureaent  type  experienced  is  rejected. 


Even  though  the  null  hypothesis  is  rejected,  it  aay  be 
reasoned  that  the  heavier  eaphasis  on  negotiated 
procureaents  resulted  fron  the  inclination  of  the 
questionnaire  toward  large  activity  procureaents  with  their 
dependence  on  negotiation. 


E.  Type  cf  Contract 


Table  22  presents  the  frequencies  for  type  of  contract 
used  in  the  questionnaire  saaple  and  the  hypothesized  000 
population.  The  category  "Other  H which  included  such 
instruaents  as  Blanket  Ordering  lgreeaents,  was  oaitted  froa 
consideration. 

TABLE  22 


Contract  Type  Frequencies 


Observed 

SlESSlSi 

Fixed  Frice 

633 

647 

Cos t-Beiaburse sent 

m 

m 

895 

895 

r 1 degree  of 

freedoa  end  o< 

equal  to 

Chi-square  critical  region  is  defined  as  3.84  to  infinity. 
The  Chi-Square  value  for  contract  type  equals  1.09,  and  the 


□all  hypothesis  that  the  sample  selected  vas  representative 
of  the  DOE  population  with  regards  to  contract  type  utilized 
is  rejected. 

Part  2 


In  this  seccnd  part,  the  overall  rating  given  to  both  DCAS 
and  the  Plant  Cog  activities  was  coapaied  to  the  responses 
given  on  each  of  the  functional  questions  in  that  general 
category.  The  purpose  of  the  analysis  was  to  determine 
whether  the  ratings  given  to  the  individual  functional 
questions  were  independent  of  the  ratings  given  in  the 
overall  question.  Since  aore  than  one  attribute  vas  under 
investigation,  a Chi-Square  test  for  independence  vas  used 
to  analyze  the  data. 

The  Statistical  Package  for  the  social  Sciences  (SPSS) 
was  used  to  ccapute  the  Chi-Square  statistic  for  each  cf  the 
questions.  However,  statistical  significance  depends  not 
only  on  the  strength  of  the  observed  relationship 
(independent  vs.  dependent) , but  on  the  size  of  the  sample. 
Since  each  respondent  did  not  answer  every  question,  the 
sawple  size  varied  in  each  coaparison.  Further  tests  of 
statistical  significance  only  indicate  the  likelihood  that 
an  observed  relationship  actually  exists  in  the  universe; 
they  do  not  tell  how  strong  the  relationship  is.  For  these 
reasons,  additional  statistics  to  correct  for  saapie  size 
and  tc  leasers  the  strength  of  the  relationships  were 
computed.  These  statistics  were: 
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(1)  PHI  ( ^ ) - For  a 2 x 2 contingency  table.  Phi 
aakes  a ccrrecticn  for  the  fact  that  the  value  of  Chi-Sguare 
is  directly  proportional  to  the  number  of  cases  (H)  by 
adjusting  the  Chi-Sguare  value.  Its  formula  is: 


Phi  takes  on  the  value  of  0 when  no  relationship 
(independence  ) exists,  and  the  value  of  1 when  the 
variables  are  perfectly  related  (dependence.)  Although  a 
universally  accepted  definition  of  the  strength  of  this 
association  is  not  possible,  Harascuilo  [ 1 ] suggests  the 
following  guidelines: 


SitSfLSlb  o£  Association 
Weak 

dcderate 

Strong 


Bange  of  Phi 

0 < Phi  < .33 

.33  < Phi  < .67 

.67  < Phi  < 1.00 


(2)  Contingency  Coefficient  (Cont  Coeff)  - This  is  also 
a aeasure  of  association  based  upon  the  Chi-Sguare  aeasure. 
Its  foraula  is:  ✓ v i 


\K 


X 


The  Contingency  Coefficient  has  a ainiaua  value  of  0,  but 
has  a aaxiaua  value  of  .707  when  using  a 2 x 2 contingency 
table.  HcHeaar  £ 2 ] suggests  that  the  Contingency 
Coefficient  has  a decided  advantage  over  other  aeasures  of 
relationship  since  no  assuaptions  involving  the  nature  of 
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the  variables  need  be  net 


(3)  Lanfcda  * This  measure  of  association  determines  the 
percentage  of  improvement  in  our  ability  to  predict  the 
value  of  the  dependent  variable  once  the  value  of  the 
independent  variable  is  known.  The  formula  is: 


yfk 

' k bl~  iwoc-f*. 


where  £ max  fj^  represents  the  sun  of  the  maximum  values  of 
the  cell  frequencies  in  each  column,  and  max  f^  represents 
the  maximum  value  of  the  row  totals.  The  maximum  value  of 
Lambda  is  1.0  which  occurs  when  prediction  can  be  made 
without  error,  i.e.,  when  each  independent  variable  category 
is  associated  with  a single  category  on  the  dependent 
variable. 


Appendix  E,  Tables  D - 1 through  D - 8,  reflects  ths 
statistical  measures  obtained  by  using  a 2 x 2 contingency 
table.  In  the  contingency  tables,  responses  for  each 
functional  question  and  the  overall  question  are  compared 
with  the  responses  categorized  as  either  favorable  or 
unfavorable  with  no  comment  or  no  answer  responses  omitted. 
In  all  cases,  the  Chi-Square  statisitc  was  used  to  test  the 
uull  hypothesis  that  no  relationship  existed  between  the 
variables  (independence.)  The  alternate  hypothesis  was  that 
a systematic  relationship  (dependence)  did  exist.  Since  the 
SPSS  proqram  computed  the  actual  levels  of  significance,  no 
prior  assumptions  were  made  concerning  an  acceptable  level 
of  significance.  Thus,  a level  of  significance  of  .0001 
would  indicate  that  the  cell  frequencies  deviate  so  much 
free  what  would  be  expected  under  conditions  of  statistical 
independence,  one  would  conclude  that  a systematic 
relationship  does  exist,  although  one  would  be  taking  a 
chance  cf  being  wrong  one  (1)  time  out  of  every  10,000.  In 
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other  words , a table  with  as  large  a deviation  from  expected 
frequencies  would  occur  by  chance  in  oniy  one  (1)  sample  out 
of  10,000.  In  this  case,  it  could  be  said  that  the 
Chi-Sguare  is  statistically  significant  at  the  .0001  level. 


A.  General  Contract  Administration 


Table  D * 1 in  Appendix  0 reflects  the  result  cf  the 
analysis  for  the  ratings  given  DCAS  in  the  General  Contract 
Adainistraticn  category.  In  all  cases,  one  has  to  reject 
the  null  hypothesis  that  no  relationship  existed 
(independence) , and  accept  the  alternate  hypothesis  that  a 
systematic  relationship  does  exist  (dependence.) 
Purthermcre,  in  all  cases,  this  result  was  statistically 
significant  at  a level  of  less  than  .0001.  Using  the  Phi 
statistic  tc  measure  the  strength  of  the  relationship  with 
the  adjustment  for  the  number  of  cases  provided  the 
following  results  in  accordance  with  Harascuilo's 
guidelines: 

St&Sflalk  Association 
Weak 

rod er a tv 
Strong 

The  results  obtained  for  the  Contingency  Coefficient  also 
generally  demonstrated  a similar  strength  of  association. 
The  Lambda  statistic  shoved  a greater  variation.  Its 
computation  indicated  that  knowledge  of  the  rating  given  tc 
a functional  guestion  would  increase  an  individual's 
predictive-  ability  concerning  the  rating  given  the  overall 
guestion  fccm  zero  improvement  or  0*  to  more  than  a 33* 
improvement. 


Number  of  Questions 
6 
ib 

Bone 


Table  0 - 2 of  Appendix  0 indicates  the  results  cf  the 

analysis  for  the  ratings  given  Plant  Cognizance  activities 
in  the  General  Contract  Administration  category.  Using  a 
level  of  significance  of  .05  for  acceptance  of  the  null 
hypothesis,  it  was  determined  that  the  null  hypothesis  would 
be  accepted  in  two  (2)  cases  while  the  alternate  hypothesis 
would  be  accepted  in  all  other  cases  at  a level  of 
significance  of  .0002  or  less.  Use  of  the  Phi  statistic 
shewed  the  following  results: 

Strength  of  Association  number  g|  Questions 

Heak  5 

Hoderate  16 

Strong  None 


The  Contingency  Coefficient  again  verified  the  results 
obtained  for  Phi.  However,  the  Lambda  measure  indicated  11 
questions  where  an  individual's  predictive  ability  would  not 
shew  improvement  and  only  2 questions  where  it  would  be 
above  the  209  level. 

B.  Producticn 


Table  3 - 3 reflects  the  results  of  the  analysis  for  the 
ratings  given  DCAS  in  the  Production  category.  In  all 
cases,  the  null  hypothesis  that  no  relationship 
(independence)  exists  was  rejected,  and  the  alternate 
hypothesis  that  a systematic  relationship  does  exist 
(dependence)  was  accepted.  In  all  cases,  this  result  was 
statistically  significant  at  a level  of  less  than  .0001. 
The  Phi  statistic  showed  the  following  results: 


47 


of  Association 
Weak 

Moderate 

Strong 


Sunber  of  Questions 
1 

16 

None 


The  Contingercy  Coefficient  .trifled  the  results  obtained 
for  Phi.  The  Lanbda  statistic  desonstrated  a such  stronger 
inprovenent  in  the  predictive  ability  relative  to  the  rating 
given  the  overall  question.  Ten  guestions  eere 
characterized  as  above  30*  in  predictive  inprovenent,  while 

guestions  indicated  zero  inprovenent  in  predictive 
ability. 


Table  D - 4 contains  the  results  of  the  analysis  fcr  the 

“‘“gs  9l,e"  the  Elant  activities  in  the  Production 
functions.  In  all  cases,  the  null  hypothesis  that  no 
relationship  (independence)  ezists  is  rejected,  and  the 
alternate  hypothesis  that  a systenatic  relationship 
(dependence)  exists  is  accepted.  In  addition,  in  all  cases, 
this  result  was  statistically  significant  at  the  level  of 
less  than  .0001.  The  Phi  statistic  sho.ed  the  fcllo.ing 


o t Association 
Weak 

Moderate 

Strong 


laikSI  of  Questions 
1 

16 

Bono 


The  coating* rcy  Coefficient  verified  the  results  obtained 
for  Phi.  The  Lanbda  statistic  did  not  shov  as  strong  an 
inprovenent  in  predictive  ability  relative  to  the  overall 
rating  as  the  ether  three  categories.  Only  « guestions  .ere 
above  30»  inprovenent  in  pr.dictive  ability,  and  again,  none 
of  the  guestions  showed  zero  inprovenent. 
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C.  Quality  Assurance 


Table  D - 5 of  Appendix  D shows  the  results  c£  the 
analysis  for  the  ratings  given  OCAS  in  Quality  Assurance. 
In  all  cases,  the  null  hypothesis  that  no  relationship 
(independence)  exists  is  rejected,  and  the  alternate 

hypothesis  that  a systematic  relationship  (dependence)  is 
accepted.  In  all  cases,  this  result  was  statistically 
significant  at  a level  of  less  than  .0001.  The  Phi 
statistic  demonstrated  the  following  results: 


Strength  of  Association 
Weak  - 
Hoderate 
Strong 


Humber  of  Questions 
None 
16 

Hone 


In  addition  to  the  above  distribution,  all  of  the  Phi 
statistics  were  above  .50.  The  Contingency  Coefficient 
statistics  confirmed  a strong  association.  The  lambda 
statistic  demonstrated  a much  stronger  improvement  in 
predictive  ability  relative  to  the  rating  given  the  overall 
question.  Every  question  was  above  the  30*  level  with  8 of 
them  being  above  the  50*  level. 

Table  D - 6 indicates  the  results  of  the  analysis  for 
the  ratings  given  the  Plant  Cognisance  activities  in  the 
Quality  Assurance  area.  In  every  case,  the  null  hypothesis 
that  no  relationship  (independence)  exists  is  rejected  and 
the  alternate  hypothesis  that  a systematic  relationship 
(dependence)  does  exist  is  accepted.  In  all  cases,  this 
result  was  statistically  significant  at  a level  of  less  ta^n 
.0001.  The  Ehi  measure  showed  the  following  results: 
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Strength  of  Association 
Weak 

Hoderate 

Strong 


Number  of  Questions 
None 
16 

None 


All  of  the  Phi  statistics  were  above  .51.  Furthermore,  the 
Contingency  Coefficient  confirmed  a strong  association.  The 
Lambda  statistic  demonstrated  a strong  improvement  in 
predictive  ability  restive  to  the  rating  given  the  overall 
question.  Twelve  question*  were  above  the  3QS  level  with 
three  questions  above  SOX. 


D.  Engineering 


Table  C - 7,  Appendix  D,  shows  the  results  cf  the 
analysis  for  the  ratings  given  OCAS  in  Engineering.  In  all 
cases,  the  null  hypothesis  that  nc  relationship 
(independence)  exists  is  rejected,  and  the  alternate 
hypothesis  that  a systematic  relationship  (dependence) 
exists  is  accepted.  In  all  cases,  this  result  was 
statistically  significant  at  a level  of  less  than  .0001. 
The  Phi  statistic  generated  the  following  frequencies: 


of  Association  Number  o£  Questions 

Weak  None 

Hoderate  11 

Strong  5 

The  Contingency  Coefficient  confirmed  a strong  association. 
The  lambda  statistic  also  showed  a strong  improvement  in 
predictive  ability  concerning  the  rating  given  the  overall 
questions.  All  the  questions  were  above  the  30X  level  with 
13  guestiens  being  above  50X. 
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Table  D - 8 reflects  the  results  of  the  analysis  for  the 
ratings  given  Plant  Cognizance  activities  in  the  Engineering 
functions.  In  all  cases,  the  null  hypothesis  that  no 
relationship  (independence)  exists  is  rejected,  and  the 
alternate  hypothesis  that  a systematic  relationship 
(dependence)  does  exist  is  accepted.  Again,  in  all  cases, 
this  result  was  statistically  significant  at  a level  of  less 
than  .0001.  The  Phi  statistic  shoved  the  following  results: 


Strength  of  Association 
Beak 

Moderate 

Strong 


Number  of  Questions 
None 
15 
2 


The  Contingency  Coefficient  confirmed  a strong  association. 
The  Lambda  statistic  demonstrated  a strong  improvement  in 
predictive  ability  relative  to  the  rating  given  the  overall 
guestion.  All  the  questions  were  above  the  30*  level  with  8 
guestions  above  50*. 


Part  3 


In  this  third  part,  the  overall  rating  given  to  both 
CCAS  and  the  Plant  Cognizance  activities  was  compared  to 
each  of  the  demographic  characteristics.  A Chi-Square  test 
for  independence  was  used  to  analyze  the  data.  The  purpose 
of  the  test  was  to  determine  whether  the  ratings  given  each 
CAS  component  in  the  overall  question  were  independent  of 
the  demographic  characteristics  of  the  questionnaire 
respondents. 

before  the  SPSS  Program  could  be  used  to  compute  the 
Chi-Square  statistic  and  the  additional  statistics  to 


51 


measure  tte  strength  o£  association  and  correct  for 
differences  in  sample  size,  certain  data  aodif ications  were 
accomplished . In  using  the  Chi-Square  distribution  in  these 
circumstances,  one  aust  be  careful  not  to  utilize  categories 
having  snail  expected  frequencies.  Although  the  rule  of 
thumb  in  Chi-Square  tests  had  been  that  the  expected 
frequency  should  be  at  least  five,  recent  research  has 
indicated  that  an  expected  frequency  of  one  or  more  in  each 
category  is  usually  sufficient.  [ 3 j The  ' simpliest 
nethod  cf  data  aodif ication  to  increase  the  expected 
frequencies  fcr  this  test  is  to  collapse  two  or  aore 
adjacent  or  similar  categories.  The  revised  categories  are 
shewn  in  Appendix  D.  As  in  Part  2,  contingency  tables  were 
constructed  and  the  same  statistics  to  measure  the  strength 
of  association  were  utilized  with  one  exception,  that  of 
Phi.  When  Phi  is  calculated  for  a table  which  is  net  2x2, 
it  has  nc*  upper  Unit.  Therefore,  since  most  of  the  tables 
for  Part  3 were  larger  than  the  2x2  version,  Cramer's  V 
was  used  to  adjust  Phi  for  either  the  number  of  rows  or  the 
nuaber  cf  columns  in  the  table,  depending  upon  which  cf  the 
two  is  smaller.  The  formula  fcr  Cramer's  7 is: 

-JL ,\* 

Craaer's  V ranges  from  zero  to  +1  when  several  ncainal 
categories  are  involved. 

In  all  cases,  the  Chi-Square  statistic  was  utilized  to 
test  the  null  hypothesis  that  no  relationship  (independence) 
existed  between  the  variables.  The  alternate  hypothesis  was 
that  a s ysteaatic  relationship  (dependence)  did  exist. 
Since  the  SPSS  prograa  computed  the  actual  level  of 
signif icarce,  no  prior  assuaptions  were  sade  concerning  an 
acceptable  level  of  significance.  However,  since 
"ordinarily,  social  scientists  accept  the  .05  level  of 
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significance  as  the  value  of  alpha,”  [ 4 ] It  was  decided 
that  this  level  would  be  used  for  the  purposes  of  testing. 
It  was  also  decided  th&r  one  would  consider  the  strength  of 
association  when  arriving  at  conclusions  based  upon  the 
testing  and  results  thereof. 

Appendix  F contains  the  data  obtained  using  the 
aforementioned  analysis. 


A.  General  Ccntract  Adainistration 


Table  F - 1 in  Appendix  P reflects  the  results:  cf  the 
analysis  for  ECAS  in  the  General  Contract  Adainistration 
category.  In  cnly  four  cases  would  the  null  hypothesis  that 
the  demographic  characteristic  was  independent  of  the 
overall  rating  at  the  .05  level  of  significance  be  rejected. 
The  four  guestions  pertained  to  the  guestionnaire 
respondents'  Service  of  the  Activity,  their  Job  Title,  their 
Supervisory  Status  and  Current  Product  Specialty.  Further 
examination  of  the  statistics  for  these  four  guestions 
indicate  cnly  a weak  strength  of  association  and  only  in  the 
case  of  Job  Title  was  there  any  increase  in  the  ability  to 
predict  the  overall  rating  once  the  demographic 
characteristic  w ns  known.  This  one  increase  was  less  than 
2*. 


Table  P - 2 reflects  the  results  of  the  analysis  fcr  the 
Plant  Cognizance  activities  in  the  General  Contract 
Administration  category.  In  all  cases  except  one  , the  null 
hypothesis  of  independence  would  be  accepted  at  the  .05 
level  of  significance.  The  guestion  pertaining  to  Job  Title 
showed  a wea.\  degree  of  association  with  both  Cramer's  V and 
the  Contingency  Coefficient  being  just  over  .16.  Further, 
Lambda  indicated  a weak  association  indicating  that  the 
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art*?* 


predictive  ability  concerning  the  overall  rating  would  not 
show  a statistical  increase  even  if  the  respondent's  Job 
Title  was  kncwn. 


B.  Production 


Table  F - 3 contains  the  results  of  the  analysis  for 
GCAS  in  the  Production  area.  In  only  one  case  was  the  null 
hypothesis  (independence)  rejected  in  favor  cf  the  alternate 
hypothesis  that  the  variables  were  dependent.  Both  eraser's 
V and  the  Contingency  Coefficient  measured  the  degree  of 
association  at  just  over  .2.  Lambda  indicated  that 
predictive  ability,  knowing  the  respondent's  Job  Title, 
would  only  increase  approximately  2.71. 

Table  F - u in  Appendix  P reflects  the  result  of 
analysis  for  the  Plant  Cognizance  activities  in  the 
Production  category.  In  only  one  case  was  the  null 
hypothesis  (independence)  rejected.  The  question  pertaining 
to  the  Number  of  Employees  Supervised  indicated  that  there 
was  a degree  of  dependence*  However,  this  question  is 
somewhat  misleading  because  one  of  the  valid  responses  to 
this  guestics  was  that  the  respondent  was  sot  a supervisor. 
Therefore,  since  one  of  the  categories  was  totally 
dissimilar  from  the  other,  this  question  was  considered 
invalid  for  statistical  purposes,  and  was  not  analyzed 
further. 

C.  Quality  Assurance 


Table  F - 5 in  Appendix  P reflects  the  result  of  the 
analysis  for  CCAS  in  the  Quality  Assurance  category.  In 
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four  of  the  cases,  the  null  hypothesis  (independence)  was 
rejected  in  favor  of  the  alternate  hypothesis.  The 
denographic  characteristics  of  Job  Title,  Supervisory 
Status,  Huater  of  Employees  Supervised  and  Current  Product 
Specialty  represented  the  four  rejections  of  the  null 
hypothesis.  The  Humber  of  Eaployees  Supervised  was 
disregarded  for  the  reasons  outlined  above.  Job  Title 
showed  the  highest  degree  of  association  with  both  Craaer's 
V and  the  Contingency  Coefficient  being  about  27%.  laabda 
indicated  an  iaproveaent  of  over  9%  in  predictive  ability. 
Supervisory  Status  and  Current  Product  Specialty  both  showed 
a lesser  degree  of  association,. 

Table  ? - 6 reflects  the  result  of  the  analysis  for 
Plant  Ccgnizance  activities  in  the  Quality  Assurance 
category.  In  all  cases  except  one,  the  null  hypothesis  was 
easily  accepted  with  aost  variables  indicating  a strong 
degree  of  independence.  Job  Title  was  the  only  variable 
which  net  the  test  for  dependence,  but  while  Cramer's  V and 
the  Contingency  Coefficient  shoved  a strength  of  associative 
at  the  .22  level,  Laabda  showed  only  a 1%  increase  in 
predictive  ability. 


0.  Engineering 


Table  E - 7 contains  the  results  of  the  analysis  for 
ECA5  in  the  Engineering  category.  In  two  cases,  the  null 
hypothesis  (independence)  was  rejected  in  favor  of  the 
alternate  hypothesis  (dependence).  Type  of  Activity  and 
Supervisory  Status  would  both  be  considered  dependent  at  the 
specified  level  of  significance,  but  otner  variables  which 
aet  the  test  for  independence  still  showed  a greater  degree 
of  association.  As  on  example,  nice  other  variables  showed 
an  increase  in  predictive  ability  while  still  aeeting  the 
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test  for  independence.  Job  Title  aet  the  test  for 
independence  while  showing  a eraser's  7 and  Contingency 
Coefficient  greater  than  .17  with  an  increase  in  predictive 
ability  of  acre  than  9X. 

Table  F - 8 in  Appendix  F reflects  the  result  cf  the 
analysis  for  Plant  Cognizance  activities  in  the  Engineering 
category.  Again,  in  only  two  cases  was  the  null  hypothesis 
(independence)  rejected  in  favor  of  the  alternate' hypothesis 
(dependence.)  Type  of  Activity  and  Average  Dollar  Value  Per 
Contract  were  both  considered  dependent  at  the  specified 
level  of  significance.  eraser's  7 and  the  Contingency 
Coeff iciest  were  less  than  .2  in  both  cases  with  an 
insignificant  increase  in  predictive  ability.  Just  as  in 
the  analysis  of  DCAS  Engineering,  ether  variables  indicated 
just  as  strong  or-  stronger  degrees  of  association  while 
still  seeting  the  test  for  independence. 


Part  4 


To  detersine  if  there  was  a significant  difference 
between  the  overall  ratings  given  DCAS  and  Plant  Cognizance 
activities  in  each  category,  the  results  of  the  analysis 
were  exaiined  frea  two  different  perspectives.  First,  the 
overall  results  for  the  entire  saaple  were  compared  on  the 
basis  of  a favorable/unfavorable  response.  Secondly,  the 
SPSS  pregraa  had  the  capability  to  select  only  those 
respondents  who  had  evaluated  both  DCAS  and  the  Plant 
Cognizance  activities  on  the  overall  guestions,  thereby 
giving  a aeasure  of  "head-'to-bead"  coapetition  with  an 
understandably  saaller  saaple.  The  f avorable/unf avcrable 
categorization  was  again  used. 

Table  23  reflects  the  results  obtained  when  the  entire 
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saaple  was  included.  It  should  be  noted  that  some 
respondents  say  have  rated  only  DCAS  or  Plant  Cognizance 
activities  and  not  both. 

TABLE  23 


Overall  OCAS  / Plant  Cog  Batings 
(Entire  Saaple) 


DCU 

Hint  Cog 

UlQS. 

Mi! 

No. 

Pavor 

Unf  av 

No. 

Cent  Adain 

72.4 

27.6 

586 

79.2 

20.8 

466 

Production 

67.5 

32.5 

453 

72.6 

27.4 

365 

C.  A. 

64.  0 

36.0 

445 

70.5 

29.5 

295 

Engineering 

46.9 

53.1 

326 

55.7 

44.3 

264 

Table  24 

reflects  the 

results 

obtained 

when  only 

the 

respondents  who 

rated  both 

DCAS  and 

Plant 

Cognizance 

activities  were 

considered. 

The  nuaber  in 

parentheses 

represents  the 
criterion. 

nuaber  of 

respondents 

which 

aet  this 

TABLE  24 

Overall  DCAS  / 

Plant  Cog  Ratings 

(Liaited 

Saaple) 

OCAS 

giant  £og 

1&12L 

Onfavor 

gavof 

flavor 

Cont  Adain  (384)  72.7* 

27.3* 

77.6* 

22.4* 

Prod  (257) 

67.3* 

32.7* 

71.7* 

28.3* 

C.  A.  (243) 

60.5* 

39.5* 

69.5* 

30.5* 

Engin  (203) 

41.4* 

58.6* 

51.2* 

48.8* 

Cl 

W i 


& Chi-Square  test  ◦£  homogeneity  was  used  tc  test 
whether  there  was  a real  difference  of  opinion  concerning 
the  perfcraance  of  DCAS  and  the  Plant  Cognizance  activities. 
The  Chi-Square  test  of  homogeneity  is  an  extension  of  the 
Chi-Square  test  of  independence.  It  is,  however,  associated 
with  different  problems.  Tests  of  homogeneity  are  ccncerned 
with  whether  different  samples  (in  our  case,  different 
degrees  of  satisfaction)  really-  are  homogeneous  with  the 
population.  This  would  mean  that  there  is  no  real 
difference  cf  opinion  among  the  respondents  on  the  ratings 
given  tc  the  two  types  of  CAS  activities.  Thus,  the  null 
hypothesis  is  that  the  favorable/unfavorable  classifications 
are  homogeneous  insofar  as  the  opinion  of  the  respondents  is 
ccncerned.  Chou  [ 5 ] suggests  that  "when  we  say  things  are 
hcmogenecus,  we  mean-  they  have  something  in  common  or  they 
are  the  same  cr  they  are  equal."  The  alternate  hypothesis 
is  that  the  classifications  are  not  homogeneous.  I each 
case,  a level  of  significance  of  .05  was  selected  for  the 
sane  reasons  cited  previously.  Therefore,  the  null 
hypothesis  would  be  rejected  if  the  computed  Chi-Square 
value  was  greater  than  3.84.  The  formula  used  to  compute 
the  testing  statistic  was: 


where  0£  was  the  observed  response  frequency,  the 
expected  response  frequency  if  the  null  hypothesis  stated 
previously  was  true  and  (S ) , the  total  number  of  respondents 
in  a particular  sample. 

The  results  of  the  above  analysis  to  determine  if  there 
was  a significant  difference  in  the  overall  ratings  given  to 
DC1S  and  to  the  Plant  Cognizance  activities  in  each  category 
are  summarized  in  Table  25. 
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TASLe  25 


Chi-Square  Homogeneity  lest 


Chi-Square 

Entire 

Result 
On  Null 

Chi-Square 

Limited 

Result 
On  Null 

Cent  Adain 

5.52 

Reject 

2.52 

Accept 

Production 

2.45 

Accept 

1.34 

Accept 

Q.  A. 

3.34 

Accept 

4.38 

Reject 

Engineering 

' 4.46 

Reject 

3.96 

Reject 

Only  in  the  case  of  Production  could  the  null  hypothesis 
that  the  classifications  are  homogeneous  be  accepted  under 
the  criteria  of  both  saaples.  Putheraore,  only  in  the  case 
of  Engineering  vould~the  null  hypothesis  in  both  saaples  be 
rejected.  It  could  then  be  concluded  that  hoaogoneity  did 
not  exist,  and  the  ratings  were  not  the  sane  or  equal.  For 
both  Contract  Adainistration  and  Quality  Assurance, 
conflicting  results  for  the  tvo  saaple  were  obtained. 
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7.  CONCLUSIONS 


This  chapter  presents  a summary  of  the  results  cf  the 
analysis  performed  in  Chapter  17*  Each  part  of  the  first 
portion  cf  this  chapter  corresponds  to  the  same  numbered 
part  in  the  previous  chapter.  Based  upon  the  analysis, 
certain  conclusions  will  be  drawn  which  reflect  the  views 
only  of  the  authors  of  this  research.  In  addition,  the 
second  portion  of  this  chapter  will  provide  some 
recommendations  for  further  study. 

CONCLUSIONS 
Part  1 


In  Part  1 of  Chapter  17,  five  characteristics  of  the 
users*  satisfaction  questionnaire  respondents  were  compared 
to  the  same  characteristics  present  in  the  DOD  procurement 


workforce 

population. 

Data  more  current  than  1972  was 

not 

available. 

However, 

where 

possible. 

inferences 

on 

projection 

of  this  data 

to  the 

present  are 

included  in 

the 

summary. 

Of  the 

five  characteristics 

utilized. 

two  (Age  and 

Type 

cf  Contract)  showed  statistically  that  the  questionnaire 
sample  was  representative  of  the  DOD  population.  Of  the 
other  three  characteristics  which  did  not  show  this 
relationship  at  a statistically  satisfactory  level,  ore  of 
them  (Procurement  Belated  Experience)  demonstrated  a similar 
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biaodal  distribution  pattern  from  which  night  be  inferred 
sene  relationship,  although,  not  a statistically  significant 
one.  Of  the  two  renaining  characteristics,  Procurement  Type 
(Negotiated  or  Fornally  Advertised)  indicated  for  both  the 
observed  and  expected  frequencies.  Negotiated  frequency 
percentages  in  the  SO's  ( Negotiated  of  Sanple  = 82.4%, 
Negotiated  cf  Population  = 87.7%.)  The  final  characteristic 
(Bank  and  GS  Bating)  deaonstrated  no  statistical  or 
inferable  relationship. 

Based  on  the  above,  it  is  concluded  that  the 
questionnaire  sanple  was  representative  of  the  DOD 
prccurenent  wcrkforce. 

Part  2 

A.  General  Contract  Administration:  For  the  General 
Contract  Administration  category,  the  overall  ratings  given 
both  OCAS  and  Plant  Cognizance  activities  were  dependent  in 
all  but  two  of  the  functional  areas  (Administration  of 
Progress  Payments  and  Surveillance  of  Contractor  Industrial 
Security  Programs)  upon  the  ratings  given  the  individual 
functions.  In  the  majority  of  cases,  the  strength  of  this 
association  could  be  termed  moderate.  It  is  therefore 
concluded  that  the  overall  rating  was  not  arbitrary,  but  did 
reflect  the  ratings  given  in  response  to  the  functional 
questions. 

Ppodpcticn:  The  overall  ratings  given  both  DCAS  and 
the  Plant  Cognizance  activities  were  dependent  in  all  cases 
upon  the  ratings  given  the  individual  functional  questions. 
In  almost  all  cases,  the  strength  of  this  association  could 
be  termed  moderate  with  a general  increase  in  predictive 
ability  relative  to  the  overall  rating  once  the  rating  to 
any  individual  question  was  known.  It  is  concluded  that  the 
overall  rating  was  not  arbitrary,  but  was  a reflection  of 
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was*- 


the  ratings  given  in  response  to  the  functional  questions. 

C..  Quality  Assurance;  The  overall  rating  given  both  DCAS 
and  the  Plant  Cognizance  activities  Here  dependent  in  all 
cases  upon  the  ratings  given  the  individual  functions  for 
Quality  Assurance.  In  all  cases,  the  strength  of  this 
association  could  be  termed  at  least  moderate  vith  all  but 
three  of  the  thirty-two  functional  questions  placing  on  the 
high  side  of  the  moderate  range.  Twelve  of  the  thirty-two 
questions  placed  higher  than  .60.  It  is  concluded  that  the 
overall  rating  is  not  arbitrary,  but  is  a reflection  of  the 
ratings  given  in  response  to  the  individual  functional 
questions. 

Dt  Engineering;  The  overall  ratings  given  both  DCAS  and 
the  Plant  Cognizance  activities  were  dependent  in  all  cases 
upon  the  ratings  given  the  individual  functions  and 
reflected  the  strongest  degree  of  association  in  all 
statistical  areas.  Seven  of  the  thirty-two  relationships 
were  categorized  as  strong,  and  twenty-five  of  the 
thirty-two  placed  on  the  higher  side  of  the  moderate  range. 
It  is  concluded  that  the  overall  rating  for  Engineering  was 
not  arbitrary,  but  was  a reflection  of  the  ratings  given  in 
response  to  the  individual  functional  questions. 

Summary | In  all  four  categories.  General  Contract 
Administration,  Production,  Quality  Assurance  and 
Engineering,  the  ratings  given  to  the  overall  questions 
("Overall,  1 would  rate  the  performance  of  the  __________ 

component  as:")  are  an  accurate  reflection  of  the  responses 
given  to  the  individual  questions,  and  represent  the 
respondents'  evaluations  of  the  applicable  categories.  In 
other  words,  the  overall  ratings  are  consistent  vith  the 
ratings  given  in  the  individual  functional  questions. 
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Part  3 


In  Part  3 of  Chapter  IV,  an  analysis  was  performed  to 
determine  if  the  overall  ratings  for  each  of  the  functional 
categories  Mas  independent  of  the  respondents'  demographic 
characteristics.  Although  in  each  category  for  both  DCAS 
and  the  Plant  Cognizance  activities  at  least  one  question 
showed  that  an  association  did  exist,  in  none  of  these  cases 
could  the  strength  of  this  association  be  termed  more  than 
weak.  while  the  overall  ratings  for  each  of  the  functional 
categories  was  in  these  feM  cases  dependent  upcn  a 
demographic  characteristic,  the  strength  of  this  association 
leads  to  the  conclusion  that  the  overall  ratings  were  not 
influenced  hy  the  respondents'  demographic  characteristics. 
In  other  ucrds,  it  is  concluded  that  the  personal 
characteristics  of  the  questionnaire  respondents,  their 
activity,  service,  etc.,  did  not  bias  their  responses  to  the 
evaluation  of  the  ECAS  and  Plant  Cognizance  performance. 

Part  4 


In  Part  4 of  Chapter  IV,  an  analysis  was  undertaken  to 
determine  if  there  was  a statistically  significant 
difference  in  the  overall  ratings  given  the  four  functional 
areas  for  the  two  types  of  CAS  activities  (CCAS  and  Plant 
Cognizance.)  Chi-Sguare  tests  of  homogeneity  were  run  with 
two  perspectives  (Entire  Sample  and  Limited  Sample.)  Based 
on  the  results,  it  is  concluded  that  there  is  a significant 
difference  ic  the  overall  ratings  given  DCAS  and  Plant  Cog 
activities  in  the  Engineering  category.  There  is  not  a 
significant  difference  in  the  Production  category.  General 
Contract  Administration  and  Quality  Assurance  demonstrated 
cccflicticg  results. 
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BECOMJJENEA  TICKS  FOE  POBTHEB  BESEABCH 


While  by  dc  means  inclusive,  the  following 
recommendations  for  further  research  and  investigation  are 
suggested. 

(a}  An  examination  of  the  relatively  low  overall  ratings 
given  the  Engineering  category  with  emphasis  on  the 
contribution  of  each  individual  question  to  the  overall 
rating. 

(b)  Development  of  a standard  by  which  the  performance 
of  the  CAS  components  could  be  measured.  At  present,  no 
guidelines  exist  as  to  whether  a 70%  favorable  rating  is 
acceptable  as  a level  of  performance  satisfaction. 

(c)  An  investigation  of  the  differences  between  General 
Contract  Administration  and  Engineering,  the  functional 
categories  having  the  highest  and  lowest  favorable  ratings 
respectively.  The  investigation  could  include  in-depth 
interviews  with  individuals  within  the  various  DOD 
activities,  and  the  gathering  cf  suggestions  for 
improvement/aodification  of  policy  and  procedure. 

While  the  above  areas  for  research  do  not  by  any  measure 
exhaust  the  possibilities  for  further  work,  they  do  point 
out  some  areas  that  do  exist.  An  extensive  amount  of  data, 
gathered  frcm  the  questionnaire  effort  exists  as  a base  for 
further  research. 
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APPENDIX  A 


ASPB  1-406 


This  appendix  contains  the  list  of  contract 
adainistrati.cn  functions  taken  from  the  1975  Edition  of  the 
Araed  Services  Procurement  Begulations,  (ASPB  1-406.) 


(i)  review  contractor's  coapensation  structure; 

(ii)  review  the  contractor's  insurance  plans; 

(iii)  review  and  approve  or  disapprove  contractor's 
reguests  for  payaents  under  the  progress  payaents  clause; 

(iv)  deteraine  the  allowability  of  costs  suspended  or 
disapproved  cn  a ECAA  Fora  1 when  a written  appeal  has  been 
received  frca  the  contractor,  direct  the  suspension  or 
disapproval  of  any  costs  when  there  is  rea^a  to  believe 
that  they  should  be  suspended  or  disapproved,  and  approve 
final  vouchers; 

(v)  negotiate  billing  and  final  overhead  rates  when  the 
contract  contains  the  clause  in  3-704,  except  when 
negotiation  respon sibility  is  placed  elsewhere  in  accordance 
with  Departaental  procedures; 

(vi)  negotiate  understandings  consistent  with  agreeaents 
negotiated  under  15-107  applicable  to  treataent  of  costs 
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under  contracts  currently  assigned  for  administration; 

(vii)  negotiate  prices  and  execute  suppleoental 
agreeaents  fcr  spare  parts  and  other  items  selected  through 
prcvisiccicg  procedures; 

(viii)  review  and  evaluate  contractor's  proposals  in 
accordance  with  3-801. 5(b)  and  furnish  comments  and 
reccmmendaticcs  to  the  procuring  contracting  officer  when 
negotiation  will  be  accomplished  by  the  procuring 
contracting  officer; 

(ix)  when  authorized  by  the  purchasing  office/  negotiate 
or  negotiate  and  execute  supplemental  agreements 
inccrpcrating  contractor  proposals  resulting  from  change 
orders  issued  under  the  Changes  clause  (Prior  to  completion 
of  negotiations  and  issuance  of  the  supplemental  agreement/ 
any  delivery  schedule  shall  be  coordinated  with  the 
purchasing  office.); 

(x)  manage  special  bank  accounts; 

(xi)  assure  timely  notification  by  the  contractor  cf  any 
anticipated  overrun  or  underrun  of  the  estimated  cost  under 
cost-type  contracts; 

(xii)  review/  approve  or  disapprove  and  maintain 
surveillance  cf  the  contractor's  procurement  system; 

(xiii)  consent  to  the  placement  of  subcontracts; 

(xiv)  monitor  contractor's  financial  condition  and 
advise  the  procuring  contracting  officer  when  contract 
performance  is  jeopardized  thereby; 

(xv)  when  authorized  by  the  purchasing  office,  negotiate 
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prices  and  execute  priced  exhibits  for  unpriced  orders 
issued  by  the  procuring  contracting  officer  under  basic 
ordering  agreements; 

(xvi)  issue  tax  exemption  certificates; 

(xvii)  conduct  post-award  orientation  ccnferences; 

(xviii)  issue  work  requests  under  maintenance,  overhaul 
and  modification  contracts; 

(xix)  negotiate  and  execute  contractual  documents  for 
settlement  of  partial  and  complete  contract  terminations  for 
convenience,  except  as  otherwise  prescribed  by  Section  VIII; 

(xx)  perform  necessary  screening,  redistribution  and 
disposal  cf  contractor  inventory; 

(xxi)  perfcrm  property  administration; 

(xxii)  prepare  findings  of  fact  and  issue  decisions 
under  the  Disputes  clause  on  matters  on  which  the  contract 
admijistraticn  office  has  the  authority  to  take  definitive 
action; 

(xxiii)  assure  processing  and  execution  of  duty-free 
entry  certificates; 

(xxiv)  in  facilities  contracts — 

(A)  evaluate  contractor’s  requests  for  facilities 
and  changes  to  existing  facilities,  and  provide  the 

procuring  contracting  officer  with  appropriate 

recommendations  *hereon; 

(£)  assure  required  screening  of  facility  items 
before  acquisition  by  contractor; 

(C)  approve  use  of  facilities  on  a 


noninterference  basis  in  accordance  witn  paragraph  (fc)  of 
the  clause  in  7-702.12; 

(E)  assure  payaent  of  any  rental  due;  and 
(E)  assure  reporting  of  iteas  no  longer  needed 
for  defense  production; 

(xxv)  perfora  production  support,  surveillance,  and 
status  reporting,  including  tinely  reporting  of  potential 
and  actual  slippages  in  contract  schedules; 

(xxvi)  perfora  pre-award  surveys; 

(xxvii)  perfora  industrial  readiness  and  aobilization 
production  planning  field  surveys  and  schedule  negotiations; 

(xxviii)  aonitcr  contractor  industrial  labor  relations 
matters  under  the  contract;  apprise  the  procuring 
contracting  officer  and  cognizant  departaental  labor 
relations  advisor  of  actual  or  potential  labor  disputes;  and 
coordinate  the  reaoval  of  urgently  required  aaterial  froa 
the  strikebound  contractor's  plants  upon  instructions  froa, 
and  authorizations  of,  the  procuring  contracting  officer  and 
the  cognizant  departaental  labor  relations  advisor; 

(xxix)  perfora  traffic  aanageaent  services  including 
issuance  and  control  of  Governaent  bills  of  lading  and  other 
transportation  docuaentation ; 

(xxx)  review  the  adequacy  of  the  contractor's  traffic 
operations; 

(xxxi)  review  and  evaluate  preservation,  packaging  and 
packing; 

(xxxii)  provide  surveillance  of  contractor  design, 
developaent,  and  production  engineering  efforts; 


design. 


(xxxiii)  review  engineering  studies,  design,  and 
proposal,  and  sake  reconaendations  to  the  systen/pro ject 
aanager  or  pcrchasing  office; 


(xxxiv)  evaluate  and  aonitor  contractor  engineering 
efforts  and  expenditures  in  accordance  with  contract  terns; 


(xxxv)  conduct  surveillance  of  contractor  engineering 
practices  with  regard  to  subcontractors; 


(xxxvi)  review,  on  a continuing  basis,  contractor  test 
plans  and  directives  for  coapliance  with  contract  terns; 
ccapare  ailestcnes;  progress,  and  cost  against  contract 
reguirenents ; 


(xxxvii)  assist  in  classification  of  waivers  and 
deviations; 

(xxxviii)  evaluate  the  adequacy  of  contractor 
engineering  cata  control  systeas,  including  assurance  that 
systeas  provide  for  finely  incorporation  of  changes  in  data 
being  acguired; 


(xxxix)  acnitor  contractor  value  engineering  prograas; 


(xl)  review  cost  reduction  proposals,  and  subait 
ccaaents  regarding  effect  of  proposed  changes  on  the 
engineering  reguirenents  ol  the  contract; 


(xli)  evaluate  and  perfora  surveillance  of  contractor 
configuration  nanageaent  systeas  and  procedures; 

(xlii)  perfora  surveillance  of  contractor  engineering 
change  systeas;  review  Class  I engineering  change  proposals, 
and  consent  on  engineering  feasibility  and  need;  assist  in 
price  analysis  of  engineering  changes;  review  Class  II 


69 


engineering  changes  to  insure  proper  classification; 

(xliii)  evaluate  the  contractor  management,  planning, 
scheduling,  end  allocation  of  engineering  resources; 

(xlii)  evaluate  and  monitor  contractor  reliability  and 
maintainability  programs; 

(xlv)  review  and  evaluate  for  technical  adequacy  the 
logistic  support,  maintenance,  and  modification  pregrams 
accomplished  ty  the  contractor; 

(xlvi)  make  appropriate  comments  to  purchasing  offices 
on  any  inadequacies  noted  in  specifications; 

(xlvii)  perform  procurement  quality  assurance; 

(xlviii)  maintain  surveillance  of  flight  operations; 

(xlix)  assure  contractor  compliance  with  applicable 
safety  reguriement s; 

(1)  assure  contractor's  compliance  with  small  business, 
later  surplus  area,  and  minority  business  enterprises 
mandatory  subcontracting  programs;  conducting,  cn  an 
as-required  basis  , small  business  and  labor  surplus  area 
set-aside  surveillance;  and  providing  advice  to  small 

business,  labor  surplus  area  concerns,  and  minority  business 
enterprises; 

(li)  ic  connection  with  classified  contracts,  administer 
these  portions  of  the  Industrial  Security  Program  designated 
as  ACO  responsibilities  in  the  ISB  and  ISH  (See  Appendix  C, 
Industrial,  Security  Begulation,  DoD  5220. 22-B,  for  partial 
listing  of  primary  responsibilities  (also  see  1-320).); 


(lii)  make  payments  on  assigned  contracts  (but  see 
20-706) ; 

(liii)  assign  and  perform  supporting  administration; 

(liv)  assure  timely  submission  of  required  reports; 

(It)  mill  advise  and  assist  defense  contractors 
regarding  their  priorities  and  allocations  responsibilities 
and  assist  defense  purchasing  activities  in  processing 
requests  for  special  assistance  and  for  priority  ratings  for 
privately-ovned  capital  equipment; 

(lvi)  process  and  execute  novation  and  change  of  name 
agreements  in  accordance  with  Section  XXVI,  Part  4; 

(lvii)  when  authorized  by  the  purchasing  office, 
negotiate  or  negotiate  and  execute  supplemental  agreements 
accelerating  cr  decelerating  contract  delivery  schedules; 

(lviii)  when  authorized  by  the  purchasing  office, 
negotiate  or  negotiate  and  execute  supplemental  agreements 
providing  for  the  de-obligation  of  unexpended  dollar 
balances  considered  excess  to  known  contract  requirements; 

(lix)  determine  adequacy  of  prime  contractor's 
Disclosure  Statements; 

(lx)  determine  whether  prime  contractor's  Disclosure 
Statements  are  in  compliance  with  Section  XV  and  Cost 
Accounting  Standards; 

llxi)  determine  contractor  compliance  with  Cost 
Accounting  Standards  and  Disclosure  Statements,  if 
applicable; 
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(lxii)  negotiate  price  adjustments  and  execute 
supplemental  agreements  pursuant  to  the  Cost  Accounting 
Standards  clause  in  7-104.83; 

(lxiii)  perform  post  award  surveillance  of  contractor 
progress  toward  demonstration  of  Cost/Schedule  Ccntrol 
Systems  tc  meet  the  Cost/Schedule  Control  systems  Criteria 
(see  7-1C4.S7),  provide  assistance  in  the  review  and 
acceptance  of  contractors*  Cost/Schedule  Control  Systems, 
and  perform  post-acceptance  surveillance  to  insure 
continuing  operation  of  contractors'  accepted  systems; 

(Ixiv)  when  authorized  by  the  purchasing  office,  issue 
amended  shipping  instructions  and,  when  necessary,  negctiate 
and  execute  supplemental  agreements  incorporating  contractor 
proposals  resulting  from  the  amended  shipping  instructions; 

(lxv)  when  authorized  by  the  purchasing  office,  issue 
change  orders  and  negotiate  and  execute  resultant 
supplemental  agreements  under  contracts  for  ship 
construction,  conversion  and  repair; 


(lxvi)  issue  contract  modifications  requiring  the 
contractor  tc  provide  packing,  crating,  and  handling 
services  on  excess  Government  property.  When  the  ACO 
determines  it  to  be  in  the  Government's  best  interests,  he 
may  secure  such  services  from  other  than  the  contractor  in 
possession  of  the  property; 


(Ixvii)  approve  contractor  acquisition/fabrication  of 
special  test  equipment  as  provided  in  paragraph  (b)  of  the 
clause  in  7-104.26; 


(lxviii)  negotiate  and  execute  contractual  documents  for 
settlement  cf  cancellation  charges  under  multi-year 
procurements;  and 
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(lxix)  evaluate  and  aonitor  contractor's  procedures  for 
complying  with  the  "Bestrictive  Markings  on  Technical  Data" 
clause  in  7-104. 9(p). 


MIYAUAItOMt  MM  IOMTICS 


APPENDIX  B 

SAMPLE  QUESTIONNAIRE 

OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 
WASHMOTON,  0.  C.  30301 


9 January  1976 


MEMORANDUM  FOR  The  Contract  Administration  Study  Participants 
SUBJECT:  Contract  Administration  Improvement  Study 


The  Assistant  Secretary  of  Defense  (Installations  and  Logistics)  has 
formally  announced  a major  study  of  the  Defense  Contract  Adminis- 
tration function  in  order  that  improved  policies  may  be  developed 
which  optimize  manpower  resources  to  accomplish  essential  tasks. 

We  have  established  four  study  teams  to  provide  recommendations 
which  will  improve  government  utilization  of  resources,  provide  con- 
tract administration  policy  improvement,  recognize  Defense -Industry 
concerns  and  survey  government  buying  activities  to  ascertain 
satisfaction  with  the  variety  of  services  currently  provided. 

You  have  been  selected  for  participation  in  this  study  effort.  The  en- 
closed questionnaire  has  been  devised  by  the  Navy  Post  Graduate 
School,  Monterey,  California,  to  gather  information  relating  to  the 
government  buying  office /contract  administration  office  interface. 

They  will  classify,  analyze  and  prepare  the  results  of  the  questionnaire 
into  a major  portion  of  the  Contract  Administration  Improvement  Study. 
An  OSD/RCS  number  has  been  secured  and  your  candid  views  are  needed. 

The  questionnaire  is  in  two  parts.  Part  I,  requests  you  to  provide 
certain  information  about  yourself  and  your  experiences  in  the  pro- 
curement process.  Your  name  is  not  required  and  replies  will  be 
coded  to  ensure  the  confidential  nature  of  your  responses.  Part  II, 
lists  the  basic  contract  administration  functions  divided  into  the  four 
general  categories  of  general  contract  administration,  production, 
quality  assurance  and  engineering. 

The  data  obtained  during  this  survey  will  be  used  to  determine  overall 
DoD  buying  office's  satisfaction  with  the  services  obtained  in  the  user- 
customer  relationship.  Your  complete  support  is  requested. 
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Enclosure  1 
Questionnaire 


JOHN  H.  KUNSEMILLER 
Director,  Contract 

Administration  A Support 


QUESTIONNAIRE  DIRECTIONS 


In  questions  (18-23),  on  the  previous  page,  you  Indicated  your  experience 
in  dealing  with  the  various  contract  administration  organizations.  Your  satis- 
faction with  the  CAS  functions  listed  on  subsequent  pages  should  be  made  in 
consideration  of  your  answers  to  those  questions. 

The  following  portion  of  the  questionnaire  consists  of  four  major  categories 
of  functions/questions.  For  each  category,  you  should  first  quickly  read  the 
functions/questions  in  that  category  and  determine  whether  you  are  sufficiently 
experienced  in  that  functional  area  to  respond  meaningfully.  If  you  do  net 
feel  qualified  to  evaluate  the  functions  in  that  category,  please  indicate  this 
by  marking  the  block  next  to  the  statement,  "I  do  not  have  sufficient  experience 
in  this  category  to  evaluate  the  following  functions",  and  then  go  on  to  the 
next  category  of  questions. 

If  you  feel  sufficiently  experienced  to  evaluate  the  functions  In  that 
category,  the  following  directions  apply.  Each  function  has  three  response 
areas  to  be  answered.  The  first  two  areas  address  your  satisfaction  with  the 
performance  of  the  Oefense  Contract  Administration  Services  (DCAS)  and  the  plant 
Cognizance  contract  administration  organizations  (Army  Plant  Activity,  NAVPRO, 
AFPRO).  The  third  area  asks  for  your  opinion  if  that  function  could  be  performed 
better  by  the  buying  office/requiring  activity. 

In  each  of  these  response  areas,  you  are  asked  to  indicate  your  evaluation 
of  the  DCAS  and  Plant  Cognizance  performance  of  the  function  by  marking  the 
block  that  best  describes  your  evaluation.  In  the  response  areas,  space  is 
available  for  a "No  Comment"  answer.  If  you  do  not  have  sufficient  experience 
to  evaluate  the  performance  of  the  organization  for  that  function,  or  have  too 
few  observations  of  their  performance  in  that  area,  please  indicate  this  by 
marking  the  block  under  "No  Comment". 

Finally,  space  has  been  provided  after  each  category  of  functions  for  your 
written  comments.  While  the  purpose  of  the  questionnaire  is  to  measure  your 
satisfaction  with  the  organizations  that  perform  contract  administration,  your 
suggestions  for  improvements  and  comments  of  a general  or  specific  nature  are 
strongly  encouraged.  If  your  comments  are  directed  toward  a particular  function, 
please  reference  the  function  number  in  your  comments.  Additionally,  the  reverse 
side  of  the  page  may  be  used  for  comments.  This  is  your  opportunity  to  Indicate 
your  satisfaction  with  the  caliber  of  services  provided  by  the  contract  adminis- 
tration services. 

After  completion  of  the  questionnaire,  place  it  in  the  envelope  provided. 

Do  not  staple  or  fold  the  questionnaire. 
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l How  do  you  rat*  th* 
\ performance  of 
\ Defense  Contract 
\ Administration 
\ Services  (OCAS) 


CATEGORY  1 

General  Contract  Administration 

1.  I do  not  have  sufficient  experience  in  this  category  to  evaluate  the 
following  functions. 

2.  Reviews  contractor  systems  (Procurement,  Compensation,  Insurance, 
Estimating,  Property  Administration). 

3.  Conducts  post-award  conference  meetings. 

4.  Negotiates  overhead  rates  (Forward  Pricing,  Billing,  Final  Overhead). 

5.  Administers  progress  payments. 

6.  Negotiates  spares  and  provisioning  items. 

7.  Negotiates  orders  under  Basic  Ordering  Agreements. 

3.  Evaluates  contractors'  proposals. 

9.  Negotiates  change  order  proposals.  “ 

10.  Administers  contractors'  subcontracting  activities. 

1 1. -  Monitors  the  contractors’  financial  conditions. 

12.  Administers  facilities  contracts. 

13.  Provides  coordination  and  information  on  matters  relating  to  Cost 
Accounting  Standards. 

14.  Evaluates  and  reports  on  anticipated  overruns  or  underruns  on  cost- 
type  contracts. 

15.  Performs  payment  functions  on  assigned  contracts. 

15.  Conducts  pre-award  surveys. 

17.  Performs  surveillance  of  Contractor  Industrial  Security  Programs. 

13.  Provides  advice  to  the  buying  office  on  all  pertinent  matters  relating  to 
contract  administration  functions. 

ID.  The  responsiveness  of  the  general  contract  administration  component 
to  requests  for  information  and/or  assistance  is  considered. 

20.  The  working  relationship  of  the  general  contract  administration  com- 
ponent with  the  contractor(s)  is  considered. 

21.  The  manning  (number  of  personnel  and  grade  level)  of  personnel  in  the 
general  contract  administration  component  is  considered. 

22.  The  technical  expertise  of  personnel  in  the  general  contract  adminis- 
ntion  component  is  considered. 

23  Overall.  I would  rate  the  performance  of  the  general  contract  admin- 
istration component  as: 
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\ zanee  Organizations  \ Requiring  Activity 
\ (Army  Plant  Activity  \ 
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k How  do  you  rate  the  \ How  do  you  rato  the  \ Could  the  function 
\ performance  of  \ performance  of  the  \ be  performed  better 
\ Defense  Contract  \ Service  Rant  Cogni-  \ by  the  Buying  Office 
\ Administration  . \ zance  Organizations^  /Requiring  Activity 
\ Services  (DCAS)  \ (Army  Rant  Activity  \ 

\ \ NAVPRO,  APPRO)  \ 


CATEGORY  2 
Production  Functions 

1.  I do  not  have  sufficient  experience  in  this  category  to  evaluate  the 
following  functions. 

2.  Performs  technical  analysis  of  Cost/ Schedule  Control  Systems  Criteria 
(C/SCSC). 

3.  Evaluates  contractor  oroduction  capabilities  in  Pre-award  surveys. 

4.  Evaluates  contractor  production  plans. 

5.  Provides  notification  to  buying  offices  of  anticipated  or  actual  contract 
schedule  delinquencies. 

6.  Performs  technical  analysis  of  contractor  jst  proposals. 

7.  Provides  notification  to  buying  offices  of  potential  or  actual  tabor 
disputes. 

8.  Performs  surveillance  of  contractor  integrated  logistics  support  man- 
agement. 

9.  Monitors  the  contractor  make  or  buy  program.  _ .. 

10.  Provides  assistance  to  contrai  or  regarding  priorities  and  allocation  in 
expediting  material  purchases. 

11.  Performs  industrial  Preparedness  Planning. 

12.  Evaluates  contractor  scrap  and  rework  program. 

13.  Performs  various  traffic  management  services. 

14.  Provides  advice  to  tne  buying  office  on  ali  pertinent  matters  relating  to 
production  functions. 

15.  The  responsiveness  of  the  production  component  to  requests  for  infor- 
mation and/or  assistance  is  considered. 

16.  The  working  relationships  of  the  production  CA3  component  with  the 
contractor  is  considered. 

17.  The  manning  (number  of  personnel  and  grade  level)  in  the  production 
component  is  considered. 

18.  The  technical  expertise  of  personnel  in  the  production  component  is 
considered. 

19.  Overall.  I would  rate  the  performance  of  the  production  component  as. 

Comments  (Um  revert*  tide  if  neeetMry) 
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.How  do  you  rat*  the\ How  do  you  rate  the\  Could  the  function 
\ poffo-manea  of  \ performance  of  the  \ be  performed  better 

\ Defense  Contract  \ Service  Plant  Co* ni-  \ by  the  Buying  Office 
\ Administration  \ ranee  Organ izationsX  /Requiring  Activity 
\ Services  (DCAS)  \ (Army  Plant  Activity  \ 

\ \ NAVPRO, AFPRO)  \ 


CATEGORY  3 

Quality  Assurance  Functions 

1.  I do  not  have  sufficient  experience  in  this  category  to  evaluate  the 
following  functions. 

2.  Mo'iito.  j contractor  quality  inspection  and  testing  to  ensure  compliance 
with  contractual  requirements. 

3.  Monitors  contractor  quality  system  to  ensure  compliance  with  con- 
tractual requirements. 

4.  Evaluates  contractor  quality  system  planning  and  procedure. 

5.  Evaluates  contractor  performance  on  corrective  action  and  disposition 
of  nonconforming  supplies. 

6.  Evaluates  contractor  quality  system  with  regard  to  materials,  special 
processes,  metrology  and  sampling. 

7.  Evaluates  contractor  quality  assurance  system  in  pre-award  surveys. 

8.  Performs  acceptance  of  non-conforming  material. 

9.  Performs  technical  evaluation  of  contractor  requests  for  waivers  and 

deviations.  ’ 2 - 

10.  Performs  technical  analysis  of  contractor  cost  proposals. 

11.  Performs  buying  office  directed  inspections. 

12.  Investigates  and  evaluates  customer  complaints. 

13.  Provides  advice  to  the  buying  office  on  all  pertinent  matters  relating 
to  quality  assurance  functions. 

14.  The  responsiveness  of  the  quality  assurance  component  to  requests  for 
information  and/or  assistance  is  considered. 

15.  The  working  relationships  of  the  quality  assurance  component  with  the 
contractor  is  considered. 

16.  The  manning  (number  of  personnel  and  grade  level)  in  the  quality 
assurance  component  is  conside.ed. 

17.  The  technical  expertise  of  personnel  in  the  quality  assurance  compo- 
nent is  considered. 

13.  Overall.  I would  rate  the  performance  of  the  quality  assurance  compo- 
nent as: 
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CATEGORY  4 
Engineering 

1.  I do  not  have  sufficient  experience  in  this  category  to  evaluate  the 
following  functions. 

2.  Evaluates  contractor  engineering  studies,  designs  and  proposals. 

3.  Evaluates  contractor  engineering  efforts  with  regard  to  expenditures. 

4;  Provides  surveillance  of  contractor  engineering  practices  with  regard  to 
subcontractors. 

5.  Evaluates  contractor  test  plans  and  directives. 

6.  Performs  technical  evaluations  of  contractors'  requests  for  waivers  and 
deviations. 

7.  Evaluates  contractors’  engineering  data  control  systems. 

8.  Evaluates  contractor  recommended  design  changes. 

9.  Provides  surveillance  of  contractor  configuration  management  systems 

and  procedures.  r 

10.  Evaluates  contractor  management  of  engineering  resources. 

1 1 . Evaluates  contractor  reliability  and  maintainability  programs. 

12.  Reviews  and  evaluates  the  contractors'  logistic  support,  maintenance 
and  modification  programs. 

13.  Provides  advice  to  the  buying  office  on  all  pertinent  matters  relating  to 
contract  engineering  functions. 

14.  The  responsiveness  of  the  Engineering  component  to  requests  for  in* 
formation  and/or  assistance  is  considered. 

15.  The  working  relationship  of  the  Engineering  component  with  the  con- 
tractors is  considered. 

16.  The  manning  (number  of  personnel  and  grade  level)  of  personnel  in 
the  Engineering  component  is  considered. 

17.  The  technical  expertise  of  personnel  in  the  Engineering  component  is 
considered. 

18.  Overall,  I would  rate  the  performance  of  the  Engineering  compo- 
nent as: 
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APPENDIX  C 


ADDITIONAL  BESPONDENT  CHAfiACTEBISTICS 


TABLE  C - 1 


Eresent  Assignaent  Experience  Level 


Category 
Less  than  1 YB 
1 - 3 IBs 
3 - 5 IBs 
5 - 1C  IBs 
Over  10  IBs 


Bespondents 

84 

253 

116 

208 

257 

318 

TABLE  C - 2 


Percentage 

9* 

27% 

13% 

23 % 

28% 

100% 


Ecocureaent  Eeieited  Experience  Level 


Less  than  1 IB 
1 -5  TBs 
5-10  TBs 
10  - 2C  IBs 
Over  20  IBs 


Bespondents 

39 

182 

168 

346 

183 

318 


Percentage 

4% 

20% 

18% 

38% 

Ui 

100% 


81 


TABLE  C - 3 


Respondent  product  Specialty 


Category 

Respondents 

Percentage 

Aircraft,  Missiles 

422 

46* 

Electronic 

225 

25% 

Services 

68 

7% 

Shipboard 

52 

6% 

Mechanical 

32 

3% 

Autoactive 

15 

2% 

Construction 

10 

1% 

Electrical 

6 

1* 

Fuel 

• 

Other 

& 

31 

918 

100% 

Contract  Type 

TABLE  C - 4 

Most  Often  Encountered 

Respondents 

Percentage 

53* 

PP 

483 

FPI 

150 

16* 

CPFF 

129 

14* 

CPIF 

123 

13* 

CPA  F 

10 

1* 

Other 

U 

3' 

918 

100* 

82 


APPENDIX  D 


TABLES  D - 1 TO  D - 8 


Key  tc  Independent  Variable  Abbreviations 

First  and  Second  Alpha  Characters:  Functional  Category 

ca  * General  Contract  Adninistration 
pd  » Production 
ga  * Quality  Assurance 
en  * Engineering 


Nuaeric  Characters:  Eefers  to  the  nuaber  of  the  question  on 

questionnaire  in  the  applicable 
functional  category 


Last  Alpha  Character: 


a » ocAS 

b » Plant  Cognizance  Activities 


TABLE  D - 1 


GENEBAL  CCNTBACT  ADMINISTBATION  - DCAS 


Indep 

Var 

Chi  - 
Square 

Siqnif 

Phi 

Cont 

Coeff 

Lambda 

ca2a 

122.25688 

.0 

.51326 

.45663 

.33871 

ca3a 

57.95462 

.0001 

.38623 

.36029 

.17949 

ca4a 

6C. 79205 

.0001 

.37923 

.35459 

.14407 

ca5a 

36.26468 

.0001 

.29768 

.28531 

. 1 1504 

ca6a 

51.28690 

.0001 

.40400 

.37459 

.14737 

ca7a 

25.01129 

.0001 

.30741 

.29384 

.03947 

ca8a 

124.56805 

.0 

.52075 

.46188 

.13953 

ca9a 

56.37848 

.0001 

.41521 

.38347 

.19626 

calOa 

74.76306 

.000  1 

.43044 

.39537 

.19492 

cal  la 

40.61003 

.0001 

.30737 

.29380 

.02300 

ca12a 

42.15308 

.0001 

.36904 

.34622 

.14634 

cal3a 

54.7559  8 

.0001 

.37824 

.35378 

.09901 

ca14a 

46.59720 

.0001 

.36551 

.34330 

.0 

ca  15a 

22.15705 

.000  1 

.22711 

.22147 

.06349 

cal6a 

'91.7300  6 

.0 

.43387 

.39802 

.20714 

ca17a 

20.52252 

.0001 

.25026 

.24278 

.07778 

ca18a 

110.C8496 

.0 

.46267 

.41991 

.07534 

ca19a 

133.42537 

.0 

.49457 

.44332 

.19205 

ca20a 

136. 15154 

.0 

.5  1147 

.45536 

.32877 

ca2  la 

14.72088 

.0001 

.20315 

.19909 

.0 

ca22a 

141.64117 

.0 

.52587 

.46544 

.22378 

84 


I 


TABLE  D - 2 


GENESAL  CONTBACT  ADHINISTHATION  - PLAHT  COG 


Indep 

Var 

Chi  - 
sguace 

Siqnif 

ca2b 

107.53133 

.0 

ca3b 

42.70000 

.0001 

ca4b 

99.14093 

.0 

ca5b 

2.55694 

.1098 

ca6b 

37.99406 

.0001 

ca7b 

45.04013 

.0001 

ca8b 

119.79352 

.0 

ca9b 

52.30809 

.0001 

calOb 

40.68512 

.0001 

cal  1b 

36.23486 

- " .0001 

cal  2b 

27.47548 

.0001 

cal  3b 

56.03632' 

.0001 

ca14b 

45.29175 

.0001 

ca15b 

14.36896 

.0002 

■ca  16b 

54.94003 

.0001 

ca17b 

.10039 

.7514 

calflb 

96.48638 

.0 

calSb 

95.91826 

.0 

ca20b 

89.23213 

.0 

ca21b 

25.24399 

.0001 

ca22b 

94.03899 

.0 

Phi 

Cont 

Coeff 

Lambda 

.54684 

.47979 

.34722 

.40688 

.37687 

.09434 

.52765 

.46667 

.24658 

. 10411 

.10355 

.0 

.38238 

.35716 

.0 

.45204 

.41191 

.09302 

.56679 

.49310 

.07595 

.44183 

.40414 

.0 

.35955 

.33834 

.0 

.34336 

.32475 

.0 

.32106 

.30569 

.0 

.42670 

.39247 

.0 

.38757 

.36137 

.0 

.23600 

.22969 

.03509 

.42937 

.39454 

. C6780 

.04210 

.04206 

.0 

.49237 

.44173 

.0 

.47268 

.42735 

.05495 

.46591 

.42232 

.22093 

.28704 

.27590 

.0 

.48229 

.43440 

.10465 

* 

I 


05 


■ - - - 

TABLE 

D - 3 

PBODUCTION  - DCAS 

Indep 

Chi  - 

Var 

Sianif 

Phi 

Cont 
Coef  f 

Lambda 

pd2a 

57.57549 

.0001 

.49419 

.44304 

.34146 

pd3a 

76.35768 

.0001 

.44374 

.40560 

.29412 

pd4a 

112.32751 

.0 

.54181 

. 4 / o38 

.40601 

pd5a 

87.20305 

.0 

.45271 

.41244 

.20979 

pd6a 

107.68127 

.0 

.54831 

.48078 

.33333 

pd7a 

27.64354 

.0001 

.27547 

.26558 

.12195 

pd8a 

81.55818 

.0 

.61179 

.52187 

.43836 

pd9a 

75.90108 

.0001 

.53956 

.47485 

.39202 

pdlOa 

64.21870 

- .0001 

.44870 

.40938 

.26605 

pdl  la 

41.33670 

.0001 

.52375 

.46396 

.40000 

Fd12a 

47.97316 

.0001 

.44456 

.40623 

.25610 

pd13a 

24.64714 

.0001 

.33482 

.31750 

.18182 

pd14a 

156.  18250 

.0 

.62470 

.52981 

.43796 

Pd15a 

141. 62407 

.0 

.58758 

.50660 

.42748 

pd16a 

92.87177 

.0 

.49593 

.44429 

.34  167 

pd17a 

37.00287 

.0001 

.37400 

.35030 

.08889 

pd18a 

138.54114 

.0 

.59650 

.51229 

.44882 

TABLE  D - 4 


PBODUCTION  - PLANT  COG 


Indep 

Var 

Chi  - 
Square 

Siqnif 

Phi 

Cont 
Coef  f 

Lambda 

pd2b 

27.  74941 

.0001 

.36113 

.33966 

.03448 

Fd3t> 

4 3.6332 1 

.0001 

.39539 

.36769 

.17333 

pd4b 

72.79280 

.0001 

.50202 

.44666 

.29268 

pd5b 

83.73154 

.0 

.50233 

.44888 

.15217 

pd6b 

8C. 95067 

.0 

.5  1588 

.45847 

.17442 

pd7b 

26.50732 

.0001 

.30191 

.28903 

.12346 

pd8b 

30.79951 

.0001 

.39170 

.36472 

.03571 

pd9b 

33.38100 

.0001 

.37093 

.34778 

.07246 

pdlOb 

42.80136 

..  .0001 

.43501 

.39890 

.20635 

pdllb 

16.75902 

.0001 

.36269 

.34096 

.15385 

pd12b 

43.5C279 

.0001 

.45191 

.41181 

.16949 

pd13b 

26.3576  0 

.0001 

.37081 

.34768 

.19298 

Fd14b 

126.98576 

.0 

.62166 

.52796 

.40000 

Fd15b 

120.68857 

.0 

.60244 

.51603 

.43617 

pd16b 

78.04280 

.0001 

.51520 

.45799 

.34568 

Fd17b 

70.83472 

.0001 

.55438 

.48486 

.21311 

pd18b 

127.44360 

.0 

.64398 

.54143 

.48864 
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TABLE  D - 5 


QUALITY  ASSURANCE  - DCAS 


Indep 

Var 

Chi  - 
Square 

Siqnif 

Phi 

Cont 
Coef  f 

Lambda 

qa2a 

165.80324 

.0 

.6  2235 

.52838 

.51592 

qa3a 

167.11548 

.0 

.62701 

.53122 

.52866 

qa4a 

147.69235 

.0 

.62286 

.52869 

.52857 

ga5a 

153.16039 

.0 

.62511 

.53007 

.52778 

ga6a 

15  5.60710 

.0 

.66195 

.55197 

.57895 

ga7a 

118.84140 

.0 

.55804 

.48730 

.45000 

ga8a 

100.63254 

.0 

.59449 

.51101 

.50450 

qa9a 

97. 15544 

.0 

.51871 

.46045 

.33099 

qalOa 

86.03221 

_ .0 

.54691 

.47984 

.30392 

qal  la 

118.83189 

.0 

.55408 

.48466 

.43885 

ga12a 

107.59776 

.0 

.56048 

.48892 

.46324 

ga  13a 

129.45001 

.0 

.57059 

.49559 

.43151 

qa14a 

142.48566 

.0 

.58788 

.50660 

.48684 

qa15a 

1 17.94612 

.0 

.55979 

.48846 

.44361 

gal6a 

69.09839 

.0001 

.50332 

.44958 

.34615 

qal7a 

152.20864 

.0 

.62732 

.53141 

.52482 
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TABLE 

0-6 

QUALITY 

ASSURANCE 

- PLANT 

COG 

Indep 

XM 

Chi  - 
Square 

Siqnif 

Phi 

Cont 

Coeff 

Lambda 

ga2b 

111.53534 

.0 

.62738 

.53145 

.47674 

ga3b 

119.18547 

.0 

.65647 

.54878 

.52941 

ga4b 

105. 15413 

.0 

.64214 

.54033 

.51899 

gaSb 

7 1 . 04 €3  1 

.0001 

.52747 

.46655 

.36709 

ga6b 

65.31770 

.0 

.60147 

.51542 

.46667 

ga7b 

74.80908 

.0001 

.57352 

.49751 

.42647 

ga8b 

51.  4729  9 

.0001 

.51326 

.45663 

.35938 

ga9b 

59.83699 

.0001 

.49418 

. 44304 

.27500 

galOb 

46.75279 

.0001 

.47134 

.42636 

.12903 

gal  1b 

70.13521 

.0001 

.52868 

.46738 

.37333 

ga12b 

57.40215 

.0001 

.49111 

.44062 

.29767 

ga13b 

S2. 43324 

.0 

.58919 

.50763 

.39024 

ga14b 

1 15.94626 

.0 

.64809 

.54386 

.52381 

galSb 

73.68713 

.0001 

.53487 

.47164 

.37333 

ga16b 

49.28679 

.0001 

.51157 

.45544 

.26667 

ga17b 

95.87030 

.0 

.60640 

.51851 

.44737 
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TABLE  D - 7 


ENGINEEHING  - OCAS 


Indep 

Var 

Chi  - 
Square 

Siqnif 

Phi 

Cont 

Coeff 

en2a 

12  1.60291 

.0 

.71100 

.57946 

en3a 

86.44595 

.0 

.59859 

.51361 

en4a 

74. 11324 

.0001 

.56408 

.49130 

en5a 

105.55109 

.0 

.65382 

.54724 

en6a 

117.85619 

.0 

.64896 

.54437 

en7a 

48.81 133 

.0001 

.49681 

.44493 

~en8a 

140.61043 

.0 

.73755 

.59357 

en9a 

89.66  776 

.0 

.61332 

.52282 

tnlOa 

61.69493 

.0001 

.55839 

.48754 

anl  la 

116.  C8440 

.0 

.69509 

.57075 

€n12a 

70.98128 

.0001 

.60125 

.51528 

en13a 

166.17993 

.0 

.77340 

.61178 

en14a 

75.41344 

.0001 

.51257 

.45614 

enl  5a 

63.710Q4 

.0001 

.49471 

.44342 

en16a 

79.54813 

.0001 

.61470 

.52367 

en17a 

152.52061 

.0 

.73727 

.59342 

Lambda 

.68333 

.55046 

.51376 

.64228 

.62687 

.46535 

.71545 

.57627 

.52577 

.67521 

.53933 

.76119 

.44928 

-43939 

.58416 

.71852 
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TABLE  1)  - 8 


ENGINEERING  - PLANT  COG 


Indep 

Var 

Chi  - 
Square 

Siqnif 

Phi 

Cont 

Coeff 

Lanbda 

en2b 

85.55  251 

.0 

.61599 

.52447 

.56863 

eii3b 

66.16103 

.0001 

.55885 

.48784 

.51020 

€n4b 

42.02200 

.0001 

.45809 

.41647 

.41053 

en5b 

77.12706 

.0001 

.60852 

.51984 

.55435 

en6b 

98.43155 

.0 

.66030 

.55102 

.62136 

en7b 

32.00995 

.0001 

.45069 

.41088 

.36620 

en8b 

101.03076 

.0 

.67155 

.55750 

.61000 

€n9b 

65.41685 

.0001 

.55392 

.48455 

.47778 

enlOb 

44.52773 

.0001 

.49914 

.44660 

.41558 

enllb 

66.57123 

.0001 

.55808 

.48733 

.47826 

en12b 

6S. 93684 

.0001 

.59845 

.51352 

.54545 

ea13b 

10  2.26224 

.0 

.66443 

.55341 

.61765 

«n1 4b 

6C. 6899  1 

.0001 

.50165 

.44839 

.43119 

€n15b 

55.22447 

.0001 

.49757 

.44547 

.42574 

ea16b 

44.55423 

.0001 

.49353 

.44257 

.44186 

on  17b 

11£. 58925 

.0 

.69176 

.56891 

.65714 

91 


I 


i 


f 


i 

m 

l 

f 

i 


| 


APPENDIX  E 

DEMOGRAPHIC  REGROUPING 


2.  Il£S  of  Activity 

Systeas  ccamand 
Buying  Activity 

Requiring  Activity/Prograa  Office/Project  office 
Depot/ICP/Center  (includes:  stock  Point,  Depot, 

center,  and  Others) 

3.  5S£2ice  of  Agtiyity 

DS1 

Service  (includes:  Aray,  Navy,  Air  Force) 


4. 


Current  Job  Ijt^e 

Prccureaent  (includes:  PCO,  Buyer,  Prccureaent 

Analysx/Con tract  Specialist,  Negctiator/Cost 
Analyst 

Logistics  Technician  (includes:  Technician,  Logistics 

/Provisioning  Specialist) 

Quality  Assurance  Specialist 
Engineer 

Indnstrial/Production  Specialist 
Other 


5.  Bating 

0-4/GS-12  or  less  (includes:  0-2  or  less/GS-10 

oe  less,  0-3,  0-4/GS- 11,12) 
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0-5/GS- 13,  14 
0-6/GS-1 5 


6 • Status 

Military  (includes:  Aray,  Navy,  Air  Force  ) 


Civil  Service 


Under  40  (includes:  20  - 30,  30  - 40) 

Over  40  (includes:  41  - 50,  51  - 60,  Over  60) 


8 . Supervisor  Status 
No  Change 


9.  if  a Supervisor  The  Nuaber  of  Employees  Supervised 
No  Change 


Education  Level 

High  School  (includes:  High  School,  Sene  College) 

College  (includes:  College  Graduate,  Some  Graduate 

School) 

Graduate  Degrees 


SiEerience  &yel  in  fresgnt  Assignment 
5 years  or  less  (includes:  Less  than  1 year,  1 to  3 

years,  3 to  5 years) 

5 tc  10  years 
Over  10  years 


12.  Total  fiocurejent  Related  Experience 

10  years  or  less  (includes:  Less  than  1 year,  1 to  5 

years,  5 to  10  years) 


\ 
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10  tc  20  years 
Over  20  years 


13. 


£lfe.92£X  iifaicfa  Best  Describes  Current  Product 

SfissAaiii 

Blectrcnic 

Aircraft/nissiles 

Shipboard 

Services 

Other  (includes:  Automotive,  Hechaaical,  Electrical, 

Puel,  Ccnstruction  Material) 


14.  HE«  2f  Procuggaent  Most  Often  Encountered 
No  Change 

15.  Contract  lyge  Most  Often  Encountered 

Cost  (includes:  CPPP,  CPIP,  cpap  ) 

Piled  Price  (includes:  ppi,  pp) 

Other 

16*  2t  Contracts  Poc  th§  Year 

10  or  less  (includes:  Less  than  5,  5 to  10) 

11  to  20 
21  tc  50 
Over  50 

17 * MUlI  Value  Pe£  Contract 

J1CC,000  and  less 

$100,000  to  J1  nillion  (includes  $100,000  to  $500,000, 
$500,000  to  $1  million) 

$1  to  5 million 
Over  $5  million 
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IIFEACT; 

SEBVACT: 

JCBTITLE; 

BATING: 

STATUS: 

AGE: 

SUPVSTII: 

NOSUPV: 

ZLUCLE V 
EXPEHPA: 
1CTPB0CEX: 
EBODSPEC: 

TYPEPBCC: 

CCNTTXIE: 

KOCONT: 

AVDOLVAI: 


APPENDIX  P 

TABLES  P - 1 TO  P - 3 


Key  To  Table  Abbreviations 


Type  Of  Activity 
Service  Of  Activity 
Current  Job  Title 
Hank/GS  Bating 

Status  (Hilitary  or  Civilian} 

Age 

Supervisor  Status 

If  A Supervisor,  The  Number  Of  Employees 

Supervised 

Education  Level 

Experience  Level  In  Present  Assignment 
Total  Procureaent  Belated  Experience 
Category  Which  Best  Describes  Current 
Product  Specialty 

Type  Of  Procureaent  Most  often  Encountered 
Contract  Tyne  Most  Often  Encountered 
Nunber  of  Contracts  Por  The  2ear 
Average  Dollar  Value  Per  Contract 
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TABLE  P - 1 


Overall  General  Contract  Adainistration  * OCAS 


Indep 

1M. 

Chi  - 
Sauare 

Sianif 

eraser's 

1 L Rhk 

Cont 

Coeff 

Laabda 

ITPEACT 

4.14865 

.24  59 

.08414 

.08384 

.0 

SEBVACT 

5.81596 

.0159 

• . 10566 

.10507 

.0 

JCBTITLE 

17.99606 

.0030 

. 17524 

.17261 

.01852 

BATING 

4.04246 

.1325 

.08306 

.08277 

.0 

STATUS 

1.02341 

.3117 

.04760 

.04755 

.0 

AGS 

.14152 

.7068 

.01956 

.01956 

.0 

SOPVSTAT 

4.72956 

.0296 

.09407 

.09366 

.0 

HOSOPT 

7.92042 

.0945 

.11626 

.11548 

.0 

IE0CLEV 

.64501  . 

.7243 

.03318 

- 03316 

.0 

EXPEBPA 

3.  14804 

.2072 

.07329 

.07310 

.0 

TCTPHOEX 

.26002 

.8781 

.02106 

.02106 

.0 

PPODSPEC 

15.49196 

.0038 

. 16259 

.16049 

.0 

TYPEPHCC 

3. 61 €0  1 

.037* 

.08410 

.08381 

.0 

COMTTTPE 

.19  278 

.9081 

.01814 

. C1813 

.0 

SOCONT 

.98966 

.8031 

.04110 

.04106 

.0 

A VDOLVAL 

3.10920 

.3751 

.07284 

.07265 

.0 

TABLE  P - 2 


Overall 

General  contract  idainistration  - Plant  cog 


Indec 

JU 

Chi  - 
S£ua£e 

sianj 

1IPEACI 

2.  96275 

' .3974 

SIBVACT 

2. 15623 

.1420 

OOBTITU 

12.60208 

.0274 

BATING 

.0034 

.9529 

STATUS 

1.44834 

.2288 

AGE 

. 13739 

.7109 

SUPfSTAT 

2.  11754 

.7142 

NGS0P7 

1.  43694- 

.4755 

EDOCLEV 

.34608 

.8411 

expebpa 

2.  17598 

.3369 

TCTPBOEX 

5.08593 

.2786 

PBODSPEC 

.04691 

.8285 

IIPEPBCC 

.82431 

.6622 

CONTTTPE 

5.27970 

. ,524 

SOCOMT 

3.32943 

.3436 

AVDOLV1I 

1.77211 

.6210 

Crater's 
1 l Phi 

Cont 

Coeff 

Laabda 

.07974 

.07948 

.0 

.08139 

.06112 

.0 

.16445 

.16227 

.0 

.01041 

.01041 

.0 

.06144 

.06132 

.0 

.02284 

.02283 

.0 

.06741 

.06726 

.0 

.05649 

.05640 

.0 

.02725 

.02724 

.0 

.06833 

.06817 

.0 

.10447 

.10390 

.0 

.01916 

.01916 

.0 

.04206 

.04202 

.0 

. 10644 

. 10584 

.0 

.08453 

.08423 

.0 

.06968 

.06951 

.0 
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Indep 

US 

1TPEACT 

SEE VACT 

JCB1I1IE 

BATING 

STATUS 

1GE 

SUP7STA1 

JCSUP? 

EEOCLEV 

EXPBBPA 

1CTPB0CEX 

IBODSPEC 

TXPEPBGC 

CONITIPE 

KGCOHT 

ATD0L7AI 


TABLE  P - 3 


Overall  Production  - DCAS 


Chi  - 
Square 

Sianif 

Crater's 
? / Phi 

Cont 

Coeff 

3.66  947 

.2994 

.09000 

.08964 

3.73049 

.0534 

.09841 

.09793 

19.44717 

.0016 

.20719 

.20289 

1.32508 

.5155 

.05408 

.05401 

.84995 

.3566 

.05059 

.05053 

.23065 

.6310 

.02763 

.02762 

1.73738 

.1875 

.06703 

.06688 

8.32831 

.0803 

. 13559 

.13436 

2. 48708  - 

.2884 

.07410 

.07389 

5.27951 

.0714 

.10796 

.10733 

.69210 

.7075 

.03909 

.03906 

8.44800 

.0765 

.13656 

.13531 

1.51585 

.2182 

.06433 

.06420 

. 14794 

.9287 

.01807 

.01807 

.74072 

.8636 

.04044 

.04040 

2.55314 

.4658 

.07507 

.07486 

Latbda 

.0 

.0 

.02721 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 

.0 
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TABLE  P - 4 


Overall  Production  - Plant  COg 


Indep 

Ui 

Chi  ~ 
S£m§re 

Signif 

Craaer *s 

1 L PM 

Cont 

Coeff 

Lambda 

TXPBACI 

1.77211 

.6210 

.06968 

.06951 

.0 

SIBVACT 

.01953 

.8889 

.02454  * 

.02453 

.0 

JOBTITLI 

9.40357 

.0940 

. 16051 

.15848 

.0 

BATING 

.42291 

.8094 

.03404 

.03402 

.0 

STATUS 

.02559 

.8729 

.01723 

.01723 

.0 

AGE 

.12153 

.7274 

.02494 

.02493 

.0 

SUPVSTil 

.10643 

.7442 

.02347 

. 023*16 

.0 

NOSUPV 

14.90  907 

.0049 

.20211 

.19810 

.0 

EE0CL2V 

1.25011 

.5352 

.05852 

.05342 

.0 

EXPEBP A 

4.12208 

.1273 

. 1062^ 

.10568 

.0 

TOTPBOCZZ 

.04682 

.9769 

.01133 

.01133 

.0 

FBODSPIC 

1. 13813 

.8882 

.05584 

.05575 

.0 

ITPEPBOC 

.70999 

.3994 

.05383 

.^5375 

.0 

COKTTIFE 

.03642 

.9320 

.00999 

.00999 

.0 

SOCONT 

1.76097 

.6235 

.06946 

.06929 

.0 

A3DOLVAL 

4.66485 

.1981 

.11305 

.11233 

.0 
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TABLE  P - 5 


Overall  Quality  Assurance  - OCAS 


Indee 

Var 

Chi  - 
Square 

Siqnif 

eraser's 
I l Phi 

Cent 

Coeff 

Lambda 

TIPEACI 

3.43627 

.329- 

.08787 

.08754 

.0 

SEBYAC1 

3.77120 

.0521 

. .09807 

.09760 

.0 

JCBTIT1I 

34.73436 

.0001 

.2793  8 

.26908 

.09375 

BATING 

2.21532 

.3303 

.07056 

.07038 

.0 

STAIOS 

.56211 

.3267 

.05385 

.05377 

.0 

AGE 

.49588 

.4813 

.03853 

.03850 

.0 

SOP YSTAT 

6.12902 

.0133 

.12236 

.12146 

.0 

NOSOPY 

11.08227 

.0257 

.15781 

.15588 

.00625 

EEUCLEY 

.89797 

.6383 

.0449  2 

.04488 

.0 

EXPBBPA 

4.92338 

.0853 

.10518 

. 10461 

.0 

TCTEBOI2 

.71248 

.7003 

.04001 

.03998 

.0 

f BODSPZC 

17.77821 

.0014 

. 19998 

. 1960C 

.05000 

TIPEPBGC 

1.03324 

.3094 

.05384 

.05376 

.0 

CCNTTIEE 

.75362 

.6860 

.04115 

.04112 

.0 

ICCONT 

3.03525 

.3862 

.08259 

.08231 

.0 

AYOOLYAI 

1.  12805 

.7703 

.05035 

.05028 

.0 
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TABLE  i - 6 


Overall  Quality  Assurance  - Plant  Cog 


Indec 

Var 

Ciii  - 
Sauare 

Siqnif 

Craaer's 
V £ Phi 

Cont 

Coeff 

Laabda 

TYPEACT 

.70775 

.8714 

.04898 

.04892 

.0 

SEBVACT 

.01323 

.9-719 

.02932 

.02931 

.0 

JOBTITL1 

14.44621 

.0130 

.22129 

.21607 

.01149 

HATING 

1.00220 

.6059 

.05829 

.05819 

.0 

STATUS 

1.04015 

.3078 

.06991 

.06974 

.0 

AGE 

.00816" 

.9280 

.01356 

.01355 

.0 

SOPVSTAT 

1.38271 

.2396 

.07612 

.07590 

.0 

NOSOPY 

3.21137 

.5231 

. 10434 

.10377 

.0 

E EOCLE V 

.62835 

.7304 

.04615 

.04610 

.0 

EXPEBPA 

. 9088  T 

.0348 

.05550 

.05542 

.0 

ICTPBOEX 

.29789 

.8616 

.03178 

.03176 

.0 

PBODSPEC 

3.  16848 

.5300 

.10364 

. 10308 

.0 

IIPEPHCC 

.09673 

.7558 

.02990 

.02989 

.0 

CONTTIPE 

1.60620 

.4479 

.07379 

.07359 

.0 

BOCONT 

3.35334 

.3403 

.10662 

. 10602 

.0 

AVDOLVAL 

3.29408 

.3485 

.10567 

.10509 

.0 
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TABLE  P - 7 


Overall  Engineering  - DCAS 


Indep 

l3£ 

Chi  - 
Sauare 

Cramer *s 
V l Phi 

Cent 

Coeff 

Lambda 

IIPEAC1 

16.72246 

.0008 

.22649 

.22089 

.07190 

SfHVACT 

. .24  423 

.6212 

.03718 

.03715 

.0 

JOBTITIE 

9.84721 

.0797 

.17380 

.17123 

.09804 

BATIHG 

4.49867 

.1055 

.11747 

.11667 

.05e82 

STATUS 

.01095 

.9167 

.01486 

.01488 

.0 

AGE 

.09183 

.7619 

.02333 

.02333 

.0 

SUP7STAT 

4.29615 

.0382 

.12122 

. 12034 

.03922 

HCSQPV 

4.77005 

.3117 

. 12096 

.12009 

.03268 

EEUCLEV 

3.99292 

.1358 

.11067 

.11000 

.06536 

EXPEBPA 

1.05737 

.5894 

.05695 

.05686 

.01561 

TCTPBOEX 

5.89435 

.0525 

.13446 

.13327 

.05882 

EBODSPEC 

5.29457 

.7584 

. 12744 

. 12642 

.05229 

TIPEPBCC 

.00 540 

.9414 

.01216 

.01216 

.0 

COHTTYEE 

.96919 

.6160 

-05452 

.05444 

.0 

KOCOIT 

4.61721 

• 2021 

< 11901 

.11818 

.05882 

avdclvai 

4.82230 

. t853 

.12162 

.12073 

.07190 

TABLE  P - 8 


Overall  Engineering  - Plant  c0g 


Indec 

Chi  - 

lar 

Square 

TIPBACT 

9.36  110 

SEH7ACT 

.42340 

JOBIITLE 

7.70372 

SATING 

2.77144 

STATUS 

.00  568 

AGE 

.00181 

SUPfSTAI 

.04686 

NOSDPV 

3.62471 

IDUC1EV 

1. 63046. 

ezpebpa 

.67125 

IOTPHOEI 

3.07540 

SSODSPEC 

3.76472 

ITPEPBCC 

.70780 

CCHTTTEE 

3.88375 

BOCONT 

9.22383 

A7DOL7AI 

9.73825 

Signif 

Craner  's 

1 £ Phi 

.0249 

.18830 

.5152 

.06802 

.1730 

.17088 

.2501 

. 1024  6 

.9399 

.00611 

.9660 

.00562 

.8286 

.02114 

-.4592 

.11717 

.4425 

.07859 

.7149 

.05042 

.2149 

. 10793 

.4388 

.11942 

.4002 

.06416 

.1434 

.12129 

.2383 

.12649 

.0209 

.19206 

Cont 

Coeff 

.18505 

.06786 

. 16844 

.10193 

.00610 

.00562 

.02113 

.11638 

.07835 

.05036 

. 10731 

.11857 

.06403 

. 12041 

. 12549 

. 18861 


JtSMkte 

.06838 

.0 

.09402 

.0 

.0 

.0 

.0 

.03419 

.0 

.0 

.0 

.0 

.01709 

.03419 

.0 

.01709 
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APPENDIX  G 


TOTAL  S0H7BY  PBEQOENCIES 


Appendix  G is  separately  bound. 
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APPENDIX  H 

SURVEY  FREQUENCIES  ( FAVORABLE/ UNFAVORABLE  ) 

Appendix  H is  separately  bound. 
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